arXiv:2605.07079cs.CVcs.AI2026-05被引 2

用残差隐动作构建视觉特征世界模型,预测更准且速度更快。

Learning Visual Feature-Based World Models via Residual Latent Action

论文配图:Learning Visual Feature-Based World Models via Residual Latent Action
图 1 · 摘自论文原文
  • 提出残差隐动作(RLA),从DINO残差中学习,可预测未来状态。
  • 在仿真与真实数据上优于现有特征模型和视频扩散模型,速度快一个量级。
  • 适用于机器人离线策略学习,无需在线交互或人工奖励。

世界模型通过观测和动作预测未来状态。现有方法多聚焦于生成像素级视频,而基于视觉特征的世界模型预测未来特征而非原始像素,更具效率且更少产生幻觉。然而,当前方法依赖直接回归,复杂交互下预测模糊或坍缩;高维特征空间的生成建模仍具挑战。本文发现一种新形式的隐动作表示——残差隐动作(RLA),可从DINO残差中轻松学习,并具备可预测性、泛化性和时间进展编码能力。基于此,提出RLA世界模型(RLA-WM),通过流匹配预测RLA值。RLA-WM在仿真与真实数据集上超越当前最先进的特征基及视频扩散世界模型,且速度比视频扩散快一个量级以上。此外,开发两种机器人学习技术:一是仅从无动作演示视频中学习的极简世界动作模型;二是首个完全基于离线视频训练的视觉强化学习框架,采用视频对齐奖励,无需在线交互或人工奖励。

原文摘要 · Abstract (English)

World models predict future transitions from observations and actions. Existing works predominantly focus on image generation only. Visual feature-based world models, on the other hand, predict future visual features instead of raw video pixels, offering a promising alternative that is more efficient and less prone to hallucination. However, current feature-based approaches rely on direct regression, which leads to blurry or collapsed predictions in complex interactions, while generative modeling in high-dimensional feature spaces still remains challenging. In this work, we discover that a new type of latent action representation, which we refer to as *Residual Latent Action* (RLA), can be easily learned from DINO residuals. We also show that RLA is predictive, generalizable, and encodes temporal progression. Building on RLA, we propose *RLA World Model* (RLA-WM), which predicts RLA values via flow matching. RLA-WM outperforms both state-of-the-art feature-based and video-diffusion world models on simulation and real-world datasets, while being orders of magnitude faster than video diffusion. Furthermore, we develop two robot learning techniques that use RLA-WM to improve policy learning. The first one is a minimalist world action model with RLA that learns from actionless demonstration videos. The second one is the first visual RL framework trained entirely inside a world model learned from offline videos only, using a video-aligned reward and no online interactions or handcrafted rewards. Project page: https://mlzxy.github.io/rla-wm

世界模型视觉特征机器人学习流匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。