arXiv:2505.06729cs.RO2025-05被引 13

用分层结构表示环境,提升视觉语言模型导航效率

STRIVE: Structured Representation Integrating VLM Reasoning for Efficient Object Navigation

  • 构建视点、物体和房间三层环境表示,支持局部探索与全局规划
  • 在三个仿真环境上提升成功率7.1%,导航效率提高12.5%
  • 适用于需高效导航的机器人系统,尤其适合复杂室内场景

视觉语言模型(VLM)因其丰富的先验知识和强大的推理能力,被越来越多地用于目标导航任务。然而,将其应用于导航面临两大挑战:如何有效表示复杂的环境信息,以及何时、以何种方式查询VLM。环境理解不足或过度依赖VLM(如每一步都查询)会导致不必要的回溯,降低导航效率,尤其在连续环境中更为明显。为此,我们提出一种新框架,在导航过程中构建多层环境表示,包括视点、物体节点和房间节点。视点与物体节点支持室内探索与目标精确定位,房间节点则促进跨房间高效规划。基于该表示,我们设计了一种两阶段导航策略,融合由VLM指导的高层规划与低层VLM辅助探索,以高效定位目标物体。我们在三个仿真基准(HM3D、RoboTHOR、MP3D)上评估了该方法,在成功率上提升7.1%,导航效率提升12.5%。进一步在真实机器人平台验证,展示了在10个不同室内环境中完成15项目标导航任务的强鲁棒性。

原文摘要 · Abstract (English)

Vision-Language Models (VLMs) have been increasingly integrated into object navigation tasks for their rich prior knowledge and strong reasoning abilities. However, applying VLMs to navigation poses two key challenges: effectively representing complex environment information and determining \textit{when and how} to query VLMs. Insufficient environment understanding and over-reliance on VLMs (e.g. querying at every step) can lead to unnecessary backtracking and reduced navigation efficiency, especially in continuous environments. To address these challenges, we propose a novel framework that constructs a multi-layer representation of the environment during navigation. This representation consists of viewpoint, object nodes, and room nodes. Viewpoints and object nodes facilitate intra-room exploration and accurate target localization, while room nodes support efficient inter-room planning. Building on this representation, we propose a novel two-stage navigation policy, integrating high-level planning guided by VLM reasoning with low-level VLM-assisted exploration to efficiently locate a goal object. We evaluated our approach on three simulated benchmarks (HM3D, RoboTHOR, and MP3D), and achieved state-of-the-art performance on both the success rate ($\mathord{\uparrow}\, 7.1\%$) and navigation efficiency ($\mathord{\uparrow}\, 12.5\%$). We further validate our method on a real robot platform, demonstrating strong robustness across 15 object navigation tasks in 10 different indoor environments. Project page is available at https://zwandering.github.io/STRIVE.github.io/ .

目标导航视觉语言模型机器人环境表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。