arXiv:2510.10154cs.RO2025-10被引 13

让导航模型从模仿路径转向理解决策,提升泛化与真实世界表现。

CompassNav: Steering From Path Imitation To Decision Understanding In Navigation

  • 构建22000条轨迹数据集,标注所有可行动作的最优路径距离。
  • 设计动态奖励函数,根据决策信心自动调节反馈强度。
  • 7B模型在基准上超越更大闭源模型,实现在机器人上的鲁棒导航。

当前大型视觉语言模型在导航任务中主要依赖模仿专家轨迹,将复杂导航简化为单一正确路径的序列复制,严重限制了智能体的探索与泛化能力。本文提出新范式:从路径模仿转向决策理解,旨在训练真正懂得如何导航的智能体。核心贡献包括:构建包含22,000条轨迹的Compass-Data-22k数据集,其强化微调子集通过A*测地距离标注所有可行动作,全景呈现决策空间;设计一种感知差距的混合奖励函数,根据决策确定性动态调整反馈,对最优动作提供明确信号,对不确定选择给予细微评分以鼓励探索。结合SFT-then-RFT训练流程,所提CompassNav智能体不记忆固定路线,而是发展出持续判断各行动相对优劣的内部导航指南针。该方法使7B模型在目标导航基准上达到新SOTA,超越更大闭源模型,并在物理机器人上实现稳健的真实世界目标导航。

原文摘要 · Abstract (English)

The dominant paradigm for training Large Vision-Language Models (LVLMs) in navigation relies on imitating expert trajectories. This approach reduces the complex navigation task to a sequence-to-sequence replication of a single correct path, fundamentally limiting the agent's ability to explore and generalize. In this work, we argue for and introduce a new paradigm: a shift from Path Imitation to Decision Understanding. The goal of this paradigm is to build agents that do not just follow, but truly understand how to navigate. We materialize this through two core contributions: first, we introduce Compass-Data-22k, a novel 22k-trajectory dataset. Its Reinforcement Fine-Tuning (RFT) subset provides a panoramic view of the decision landscape by annotating all feasible actions with A* geodesic distances. Second, we design a novel gap-aware hybrid reward function that dynamically adapts its feedback to decision certainty, shifting between decisive signals for optimal actions and nuanced scores to encourage exploration. Integrated into an SFT-then-RFT recipe, our CompassNav agent is trained not to memorize static routes, but to develop an internal compass that constantly intuits the direction to the goal by evaluating the relative quality of all possible moves. This approach enables our 7B agent to set a new state-of-the-art on Goal navigation benchmarks, outperforming even larger proprietary models, and achieve robust real-world goal navigation on a physical robot.

导航决策理解强化学习视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。