arXiv:2602.06427cs.CVcs.RO2026-02被引 3

让机器人从户外无缝进入室内,仅靠视觉和指令导航。

Bridging the Indoor-Outdoor Gap: Vision-Centric Instruction-Guided Embodied Navigation for the Last Meters

  • 用视觉+指令驱动决策,不依赖定位系统
  • 在新数据集上成功率和路径效率均超现有方法
  • 适合真实场景中室内外连续导航任务

具身导航在最后一公里配送等实际应用中前景广阔,但现有方法多局限于室内或室外环境,且依赖精确坐标系统等强假设。当前室外方法虽可将智能体引导至目标附近,却无法实现通过特定入口的精细入室,严重制约实际部署。为此,我们提出一种新型任务:无需先验信息的出-入室指令驱动具身导航。该任务摒弃对精确外部先验的依赖,要求智能体仅根据自身视角视觉观测与指令完成导航。为此,我们设计了一种以视觉为中心的导航框架,利用图像提示驱动决策。同时,首次公开了该任务的数据集,其数据生成流程融合了轨迹条件视频合成。大量实验表明,所提方法在成功率和路径效率等关键指标上持续优于当前最优基线。

原文摘要 · Abstract (English)

Embodied navigation holds significant promise for real-world applications such as last-mile delivery. However, most existing approaches are confined to either indoor or outdoor environments and rely heavily on strong assumptions, such as access to precise coordinate systems. While current outdoor methods can guide agents to the vicinity of a target using coarse-grained localization, they fail to enable fine-grained entry through specific building entrances, critically limiting their utility in practical deployment scenarios that require seamless outdoor-to-indoor transitions. To bridge this gap, we introduce a novel task: out-to-in prior-free instruction-driven embodied navigation. This formulation explicitly eliminates reliance on accurate external priors, requiring agents to navigate solely based on egocentric visual observations guided by instructions. To tackle this task, we propose a vision-centric embodied navigation framework that leverages image-based prompts to drive decision-making. Additionally, we present the first open-source dataset for this task, featuring a pipeline that integrates trajectory-conditioned video synthesis into the data generation process. Through extensive experiments, we demonstrate that our proposed method consistently outperforms state-of-the-art baselines across key metrics including success rate and path efficiency.

具身导航视觉导航指令驱动室内外衔接

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。