arXiv:2606.24101cs.ROcs.CV2026-06中稿 · ECCV被引 2

统一建模感知、生成与控制,实现具前瞻性的智能导航

NavWM: A Unified Navigation World Model for Foresight-Driven Planning

论文配图:NavWM: A Unified Navigation World Model for Foresight-Driven Planning
图 1 · 摘自论文原文
  • 用潜在世界令牌融合几何与语义先验,提升结构理解力
  • 基于锚点的多模态轨迹预测,生成多样动作空间
  • 利用视觉前瞻闭环规划,零样本导航成功率显著提升

传统视觉导航策略在复杂环境中常因短视决策和模式坍缩而失效。现有世界模型通常将感知、生成与控制割裂,无法捕捉其共享的时空动态。本文提出NavWM,一个统一的导航世界模型,无缝整合潜在世界推理、多模态动作预测与可控视觉生成。核心在于使用潜在世界令牌提炼几何与语义先验,赋予智能体稳健的结构理解能力。为克服确定性策略局限,引入基于锚点的多模态轨迹预测框架,生成多样化动作空间。该内在多样性使生成式世界模型可作为鲁棒闭环规划器,利用视觉前瞻评估并选择最优路径。在多个机器人数据集上的大量实验表明,NavWM显著超越当前最先进水平,在高保真未来状态生成和零样本导航成功率方面均有显著提升。

原文摘要 · Abstract (English)

Conventional visual navigation policies often struggle with myopic decision-making and mode collapse in complex environments. While world models offer a promising alternative, existing paradigms typically isolate perception, generation, and control, failing to capture their shared spatio-temporal dynamics. In this paper, we propose NavWM, a unified navigation world model that seamlessly integrates latent world reasoning, multimodal action prediction, and controllable visual generation. At its core, NavWM leverages latent world tokens to distill geometric and semantic priors, endowing the agent with robust structural understanding. To overcome the limitations of deterministic policies, we introduce an anchor-based multimodal trajectory forecasting framework that generates a diverse action space. This inherent diversity explicitly empowers the generative world model to act as a robust closed-loop planner, utilizing visual foresight to evaluate and select the optimal path. Extensive experiments across diverse robotics datasets demonstrate that NavWM significantly advances the state-of-the-art, delivering remarkable improvements in both high-fidelity future state generation and zero-shot navigation success.

导航世界模型前瞻规划多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。