arXiv:2606.31071cs.CVcs.RO2026-06中稿 · ECCV

构建分层3D场景图,让智能体全局规划更高效。

Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigation

论文配图:Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigation
图 1 · 摘自论文原文
  • 用分层3D场景图整合物体、区域语义信息,形成全局记忆。
  • 基于场景图进行信念规划,长距离导航成功率提升9.4%。
  • 适合复杂环境中的长期自主导航任务,如机器人巡检。

语义导航是智能体在未知环境中运行的核心任务,需兼具语义理解与长期决策能力。现有基础模型虽提供丰富语义先验,但缺乏结构化全局表示,导致决策依赖局部观察和贪婪策略,造成探索效率低和短视行为,尤其在远距离导航中表现不佳。为此,我们提出一种零样本语义导航框架。该方法增量式维护在线的分层3D场景图(HSG),构建物体、区域、场所等多粒度语义拓扑,作为全局规划的紧凑状态抽象。在此记忆基础上,引入分层信念规划框架,融合语义先验与探索证据,在HSG驱动的模拟器上进行有限时域回溯,显式估计候选宏观动作的长期期望回报。这实现了全局一致决策,减少重复往返。在多个高保真仿真任务与数据集上的实验表明,本方法优于现有最先进方法,尤其在长距离场景中,平均提升成功率达9.4%,路径归一化得分(SPL)提升5.0%。

原文摘要 · Abstract (English)

Semantic navigation is a fundamental task for embodied agents operating in unseen environments, requiring both semantic understanding and long-term decision-making. Recent foundation models have empowered agents with rich semantic priors for this task. However, without structured global representations, decision-making often falls back on local observations and greedy strategies, resulting in inefficient exploration and myopic behaviors, especially in long-distance navigation. To address these challenges, we propose a zero-shot semantic navigation framework. Our method incrementally maintains an online Hierarchical 3D Scene Graph (HSG) to form a multi-granular semantic topology over objects, zones, and regions, serving as a compact state abstraction for global planning. Building on this memory, we introduce a hierarchical belief-based planning framework that fuses semantic priors with exploration evidence on the HSG, and performs finite-horizon rollouts on an HSG-based simulator to explicitly estimate the long-term expected returns of candidate macro-actions. This enables globally consistent decisions and reduces redundant backtracking. Extensive experiments in high-fidelity simulation environments across multiple tasks and datasets demonstrate that our method outperforms existing state-of-the-art methods, particularly in long-distance scenarios, where our approach improves SR and SPL by an average of 9.4\% and 5.0\%, respectively.

语义导航分层建图强化学习智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。