arXiv:2603.17808cs.ROcs.AI2026-03被引 8

让视频模型生成更符合机器人执行的轨迹,解决视觉流畅但动作不稳的问题。

EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards

  • 用逆动力学模型做奖励信号,训练视频模型生成可执行动作
  • 生成动作的平滑度提升,速度、加速度、加加速度更稳定
  • 适合需要真实机器人部署的视觉世界模型研究者

视频生成模型被越来越多地用作机器人世界模型,通过当前观测和任务指令生成未来视觉轨迹,再由逆动力学模型(IDM)将其转化为可执行的机器人动作。然而,现有视频世界模型缺乏显式的可执行性约束,导致视觉上连贯的轨迹可能违反刚体和运动学一致性,解码后产生不稳定或不可行的控制指令。我们称这种视觉生成与物理可执行控制之间的偏差为‘可执行性差距’。尽管可在推理时使用拒绝采样等方法缓解,但因视频生成成本高而效率低下。本文提出可执行视频对齐(EVA),一种基于强化学习的后训练框架,利用可执行性差距作为训练信号。EVA在真实机器人轨迹上训练逆动力学模型,并将其转为奖励模型,评估生成视频所诱导的动作序列,鼓励动作在速度、加速度和加加速度上保持平滑,同时惩罚违反身体约束的动作。重要的是,即使生成视频含有严重视觉伪影,该奖励仍具信息量,因为这类伪影通常对应不稳定的动作。在RoboTwin基准和真实双臂机器人上的实验表明,EVA减少了生成轨迹中的特定于身体的伪影,并提升了下游任务的成功率。

原文摘要 · Abstract (English)

Video generative models are increasingly used as world models for robotics, where a model generates a future visual rollout conditioned on the current observation and task instruction, and an inverse dynamics model (IDM) converts the generated frames into executable robot actions. However, current video world models lack explicit executability constraints. As a result, visually coherent rollouts may still violate rigid-body and kinematic consistency, producing unstable or infeasible control commands when decoded by an IDM. We refer to this mismatch between visual generation and physically executable control as the executability gap. While this gap can be mitigated at inference time using techniques such as rejection sampling, such approaches are inefficient due to the high cost of video generation. In this paper, we leverage the executability gap as a training signal and introduce Executable Video Alignment (EVA), a reinforcement-learning post-training framework for aligning video world models. EVA trains an inverse dynamics model on real robot trajectories and repurposes it as a reward model that evaluates generated videos through the action sequences they induce, encouraging smooth motions measured by velocity, acceleration, and jerk while penalizing actions that violate embodiment constraints. Importantly, the reward remains informative even when generated videos contain severe visual artifacts, since such artifacts typically translate into unstable or out-of-bound actions. Experiments on the RoboTwin benchmark and a real bimanual robot show that EVA reduces embodiment-specific artifacts in generated rollouts and improves downstream task execution success.

视频生成机器人控制强化学习世界模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。