机器人边探索边理解环境,自动选择最优视角补全未知区域。
SCOUT: Semantic scene COverage via Uncertainty-guided Traversal

- 结合不确定性规划与语义图构建,动态决定下一步观测位置。
- 通过融合几何与对象标签后验概率,实现对模糊物体的重访。
- 适合长期自主巡检、环境更新的智能机器人系统使用。
长时间运行的机器人不应仅是空间的访问者,更应逐步理解环境。然而多数3D场景图管道将感知视为固定数据集的后期处理,使场景表示与观测决策脱节。本文提出SCOUT,一种在线语义探索框架,通过将主动移动与概率性场景图构建相结合,闭环解决此问题。给定先验2D占用图和带位姿的RGB-D观测,SCOUT增量式构建具备不确定性的3D场景图:节点融合几何信息与开放词汇对象标签的后验信念,边编码如'在...上''属于''相邻'等结构关系。这些信念反馈至不确定性引导的路径规划器,该规划器综合预期语义确定性增益、几何覆盖增益与旅行成本,选择视点。因此,当对象识别模糊时机器人会重访,当场景仍不完整时则拓展至未探索自由空间。该系统将语义场景完备性作为可操作目标,而非语义地图的被动副产品,迈向能自主巡逻、更新并推理动态室内环境的智能体,极大减少人工干预。
原文摘要 · Abstract (English)
Robots that operate over extended periods should not merely visit space; they should progressively understand it. Yet most 3D scene graph pipelines treat perception as a post-processing stage over a fixed dataset, decoupling scene representation from the decisions that determine what is observed in the first place. We present SCOUT, an online semantic exploration framework that closes this loop by coupling active traversal with probabilistic scene graph construction. Given a prior 2D occupancy map and posed RGB-D observations, SCOUT incrementally builds an uncertainty-aware 3D scene graph whose nodes maintain fused geometry and posterior beliefs over open-vocabulary object labels, while edges encode structural relations such as on, inside, belong, and next to. These beliefs are fed back to an uncertainty-guided traversal planner, which selects viewpoints by balancing expected semantic certainty gain, geometric coverage gain, and travel cost. In this way, the robot revisits ambiguous objects when additional evidence matters and expands into unseen free space when the scene remains incomplete. The resulting system treats semantic scene completeness as an operational objective rather than a passive by-product of semantic mapping, moving toward autonomous agents that can patrol, update, and reason about evolving indoor environments with minimal human intervention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。