arXiv:2608.26190cs.AI2026-08

用潜在空间预测动作后果,让机器人导航更准更快

Predicting Consequences and Reinforcing Navigation Policies with Latent World Models

论文配图:Predicting Consequences and Reinforcing Navigation Policies with Latent World Models
图 1 · 摘自论文原文
  • 不重建图像,直接在潜在空间预测动作与目标的兼容性
  • 在真实数据集上预测准确率和导航成功率显著超越现有方法
  • 无需动作标注或环境交互,适合无监督学习场景

世界模型使智能体能够基于状态转移知识推理未来结果并学习策略,但现有方法主要聚焦于重建未来观测或特征,引入了不必要的复杂性且限制了决策能力。本文提出一种兼容性预测的潜在世界模型(LWM),用于机器人导航,不再重建观测,而是预测动作条件下的潜在特征兼容性。核心洞察是空间邻近性与潜在特征相似性相关,使得动作后果可直接在潜在空间评估。为支持反事实训练,模型利用跨轨迹采样的动作序列,学习判断哪些序列更接近目标。此外,我们展示了所学世界模型如何从无标签视频数据中监督策略学习,并在潜在世界内通过强化学习进一步优化策略。这一想象驱动框架无需动作标注或额外环境交互。多个真实世界机器人导航数据集上的实验表明,该方法在预测精度、策略学习和实际导航性能上均显著优于先前的世界模型和模仿学习方法。代码、预训练模型及附加材料见 https://wzm206.github.io/latent-world-model-nav。

原文摘要 · Abstract (English)

World models enable agents to reason about future outcomes and learn policies from their knowledge of state transition, but existing approaches primarily focus on reconstructing future observations or features, which introduces unnecessary complexity and limits their effectiveness for decision making. In this work, we propose a compatibility prediction Latent World Model (LWM) for robot navigation that predicts action-conditioned latent feature compatibility rather than reconstructing observations. Our key insight is that spatial proximity correlates with latent feature similarity, enabling action consequences to be evaluated directly in latent space. To support counterfactual training, our model leverages action sequences sampled across trajectories and learns to predict which sequences lead closer to the goal. Furthermore, we demonstrate how the learned world model can supervise policy learning from unlabeled video data and further improve policies through reinforcement learning entirely within the world model. This imagination-driven framework eliminates the need for action annotations and additional environment interaction. Extensive experiments on multiple real-world robot navigation datasets show that our approach significantly outperforms prior world model and imitation learning methods in prediction accuracy, policy learning, and real-world navigation performance. The code, pretrained models, and additional materials are available at https://wzm206.github.io/latent-world-model-nav.

世界模型机器人导航潜在空间无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。