统一视觉导航模型,一步生成未来图像和路径,速度快效果好
UniNav: A Unified World-Action Diffusion Model for Visual Navigation

- 用单一扩散过程联合预测未来视觉与连续路径
- 在所有数据集上准确率优于最强基线,单步推理仅需0.1秒
- 适合需要快速决策的机器人导航场景
图像目标视觉导航是具身智能体的基础能力。现有导航策略能高效预测路径点轨迹,但缺乏视觉预见性;而导航世界模型虽可预测未来观测,却常需昂贵的规划滚动。我们提出UniNav,一种统一的世界-动作扩散模型,通过单一扩散过程生成未来视觉观测和连续路径点轨迹。给定历史帧和目标图像,UniNav在单个Transformer中联合去噪视觉与路径令牌,将未来预测与动作生成统一于共享框架。为增强空间定位,引入几何感知相机令牌。同时在带轨迹标注的导航数据和仅视频数据上训练,使模型无需路径标注即可受益于多样化视频。基于此框架,提出两种变体:UniNav-Full联合预测可解释的未来观测及其对应轨迹;UniNav-Fast在推理时移除未来图像令牌,实现高效路径预测。在多个导航基准测试中,UniNav在所有数据集上的平均轨迹误差(ATE)均优于最强基线。单步推理下,UniNav-Fast延迟仅为0.1秒,精度损失小。代码将开源。
原文摘要 · Abstract (English)
Image-goal visual navigation is a fundamental capability for embodied agents. Existing navigation policies efficiently predict waypoint trajectories but lack visual foresight, while navigation world models can anticipate future observations but often require costly planning rollouts. We present UniNav, a unified world-action model that generates future visual observations and continuous waypoint trajectories through a single diffusion process. Given history frames and a goal image, UniNav jointly denoises visual and waypoint tokens within a single transformer, unifying future prediction and action generation in a shared framework. To improve spatial grounding, we incorporate geometry-aware camera tokens. We also train on both trajectory-labeled navigation data and video-only data, enabling the model to benefit from diverse videos without waypoint annotations. Based on this unified framework, we introduce two variants: UniNav-Full jointly predicts interpretable future observations and their corresponding trajectories, while UniNav-Fast removes future-image tokens at inference for efficient trajectory prediction. Experiments on navigation benchmarks show that UniNav outperforms the strongest baseline in ATE across all datasets. With one-step inference, UniNav-Fast achieves a latency of 0.1s without a substantial accuracy drop. Code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。