arXiv:2605.15705cs.ROcs.AI2026-05被引 6

用执行反馈实时修正模型预测,提升机器人在未知环境下的决策能力。

Feedback World Model Enables Precise Guidance of Diffusion Policy

论文配图:Feedback World Model Enables Precise Guidance of Diffusion Policy
图 1 · 摘自论文原文
  • 引入在线反馈状态,根据真实观测动态修正预测
  • 预测误差降低76.4%,分布外任务成功率提升30%
  • 无需额外训练,适合实际部署中的鲁棒控制

世界模型通过预测动作后果来提升机器人决策能力,但在分布外状态下其预测常不可靠。本文观察到:每次动作后,机器人可直接观测真实下一状态,揭示预测与实际的偏差。基于此,提出反馈世界模型,在推理时闭环整合预测与观测。通过维护轻量级反馈状态,在线迭代修正未来预测,利用实时观测补偿模型误差,无需额外训练数据或参数更新。该过程可解释为隐空间观测器,在弱条件下具备收敛性保证。进一步引入动作感知引导,强化可控动作成分,抑制无关变化。在LIBERO-Plus、Robomimic及真实操作任务上的实验表明,该方法显著提升预测精度与策略性能。尤其在分布外情况下,预测误差减少76.4%,成功率提升30%。结果表明,推理时引入实时反馈是一种简单而强大的替代静态建模的新范式。

原文摘要 · Abstract (English)

World models aim to improve robotic decision making by predicting the consequences of actions. However, in practice, their predictions often become unreliable once the robot encounters states outside the training distribution, limiting their effectiveness at deployment. We observe that execution itself provides a natural but underutilized signal: after each action, the robot directly observes the true next state, revealing the mismatch between predicted and actual outcomes. Building on this insight, we propose feedback world model, a new paradigm that closes the loop between prediction and observation at inference time. Instead of treating the world model as a static open-loop predictor, our method maintains a lightweight feedback state that is updated online to iteratively correct future predictions, compensating for model errors using real-time observations without additional training data or parameter updates. We show that this process can be interpreted as a latent-space observer and admits convergence guarantees under mild conditions. We further introduce action-aware guidance to better translate corrected predictions into control by emphasizing action-controllable components while suppressing irrelevant variations. Experiments on LIBERO-Plus, Robomimic, and real-world manipulation tasks demonstrate that our method substantially improves both prediction accuracy and policy performance under distribution shift. In particular, it reduces world model prediction error by up to 76.4% and improves out-of-distribution (OOD) success rate by 30%. These results show that incorporating real-time feedback at inference time provides a simple yet powerful alternative to static world modeling.

世界模型机器人控制在线修正分布外泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。