用地图思维让智能体零样本导航更高效,不依赖训练
ReasonNavi: Human-Inspired Global Map Reasoning for Zero-Shot Embodied Navigation
- 先用地图分区域选目标点,再用大模型理解指令选最优路径
- 在三个任务中超越需大量训练的旧方法,零样本表现领先
- 适合追求可解释性、无需微调的导航系统研发者
具身智能体常因依赖局部视角而难以高效导航,缺乏全局规划能力。与人类先看地图再行动的策略类似,我们提出 ReasonNavi:将顶部视角地图通过房间分割与候选目标点采样转化为离散推理空间,再通过多阶段查询多模态大模型(MLLM)选出最符合指令(物体、图像或文本目标)的候选点,有效利用其语义推理能力,规避其连续坐标预测的弱点。选定路径点后,结合在线构建的占据图与确定性动作规划器生成可执行轨迹,并使用预训练的检测器和分割器确保目标识别鲁棒性。该框架无需 MLLM 微调,避免强化学习策略的脆弱性,且能随基础模型提升自然扩展。在三个导航任务中,ReasonNavi 均显著优于需大量训练或复杂场景建模的现有方法,提供一种可扩展、可解释、全局依托的零样本导航方案。
原文摘要 · Abstract (English)
Embodied agents often struggle with efficient navigation because they rely primarily on partial egocentric observations, which restrict global foresight and lead to inefficient exploration. In contrast, humans plan using maps: we reason globally first, then act locally. We introduce ReasonNavi, a human-inspired framework that operationalizes this reason-then-act paradigm by coupling Multimodal Large Language Models (MLLMs) with deterministic planners. ReasonNavi converts a top-down map into a discrete reasoning space by room segmentation and candidate target nodes sampling. An MLLM is then queried in a multi-stage process to identify the candidate most consistent with the instruction (object, image, or text goal), effectively leveraging the model's semantic reasoning ability while sidestepping its weakness in continuous coordinate prediction. The selected waypoint is grounded into executable trajectories using a deterministic action planner over an online-built occupancy map, while pretrained object detectors and segmenters ensure robust recognition at the goal. This yields a unified zero-shot navigation framework that requires no MLLM fine-tuning, circumvents the brittleness of RL-based policies and scales naturally with foundation model improvements. Across three navigation tasks, ReasonNavi consistently outperforms prior methods that demand extensive training or heavy scene modeling, offering a scalable, interpretable, and globally grounded solution to embodied navigation. Project page: https://reasonnavi.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。