分层推理让智能体看图导航更聪明,不乱转。
Think before Go: Hierarchical Reasoning for Image-goal Navigation

- 先用视觉语言模型生成短程路线,再执行动作
- 实测在仿真和真实环境都显著减少乱走现象
- 适合需要长距离规划的视觉导航任务
图像目标导航要求智能体在未见过的环境中,根据一张目标图像到达指定位置。现有方法多采用端到端策略,直接比较目标与观测图像并预测动作,但在目标较远或位于另一房间时,难以提取有效视觉线索,导致智能体徘徊不前。受人类认知启发——高级思考指导快速执行,我们提出分层推理导航(HRNav)框架,将图像目标导航分解为高层规划与底层执行。高层规划阶段,利用自收集数据集训练视觉语言模型,生成如‘穿过门’或‘沿走廊走’等短程计划,降低长期任务难度;底层执行阶段,采用在线强化学习策略,根据短程计划决定具体动作。此外,设计新型徘徊抑制惩罚(WSP),进一步缓解徘徊问题。在仿真与真实环境中的大量实验表明,该方法性能优越。
原文摘要 · Abstract (English)
Image-goal navigation steers an agent to a target location specified by an image in unseen environments. Existing methods primarily handle this task by learning an end-to-end navigation policy, which compares the similarities of target and observation images and directly predicts the actions. However, when the target is distant or lies in another room, such methods fail to extract informative visual cues, leading the agent to wander around. Motivated by the human cognitive principle that deliberate, high-level reasoning guides fast, reactive execution in complex tasks, we propose Hierarchical Reasoning Navigation (HRNav), a framework that decomposes image-goal navigation into high-level planning and low-level execution. In high-level planning, a vision-language model is trained on a self-collected dataset to generate a short-horizon plan, such as whether the agent should walk through the door or down the hallway. This downgrades the difficulty of the long-horizon task, making it more amenable to the execution part. In low-level execution, an online reinforcement learning policy is utilized to decide actions conditioned on the short-horizon plan. We also devise a novel Wandering Suppression Penalty (WSP) to further reduce the wandering problem. Together, these components form a hierarchical framework for Image-Goal Navigation. Extensive experiments in both simulation and real-world environments demonstrate the superiority of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。