arXiv:2605.00080cs.ROcs.CV2026-05综述被引 33

机器人学习中的世界模型综述,梳理预测环境演化的关键方法与应用。

World Model for Robot Learning: A Comprehensive Survey

论文配图:World Model for Robot Learning: A Comprehensive Survey
图 1 · 摘自论文原文
  • 从机器人视角系统梳理世界模型的架构与功能角色
  • 揭示世界模型如何支撑强化学习与仿真评估
  • 适合关注机器人自主决策与环境建模的研究者

世界模型作为对环境在动作作用下演化过程的预测表征,已成为机器人学习的核心组件。它们支持策略学习、规划、仿真、评估与数据生成,并随着基础模型和大规模视频生成技术的发展迅速进步。然而,相关研究在架构、功能角色与具身应用领域仍呈碎片化分布。为此,本文从机器人学习角度开展全面综述,分析世界模型与机器人策略的耦合方式,探讨其作为强化学习与评估中可学习模拟器的作用,回顾机器人视频世界模型从想象生成到可控、结构化、基础规模形式的演进历程。进一步将这些思想延伸至导航与自动驾驶领域,总结代表性数据集、基准测试与评估协议。整体上,本综述系统梳理了机器人学习世界模型的快速扩展文献,厘清关键范式与应用场景,并指出预测建模在具身智能体中的主要挑战与未来方向。为持续提供新成果、基准与资源,我们还将维护并定期更新配套的GitHub仓库。

原文摘要 · Abstract (English)

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have advanced rapidly with the rise of foundation models and large-scale video generation. However, the literature remains fragmented across architectures, functional roles, and embodied application domains. To address this gap, we present a comprehensive review of world models from a robot-learning perspective. We examine how world models are coupled with robot policies, how they serve as learned simulators for reinforcement learning and evaluation, and how robotic video world models have progressed from imagination-based generation to controllable, structured, and foundation-scale formulations. We further connect these ideas to navigation and autonomous driving, and summarize representative datasets, benchmarks, and evaluation protocols. Overall, this survey systematically reviews the rapidly growing literature on world models for robot learning, clarifies key paradigms and applications, and highlights major challenges and future directions for predictive modeling in embodied agents. To facilitate continued access to newly emerging works, benchmarks, and resources, we will maintain and regularly update the accompanying GitHub repository alongside this survey.

机器人学习世界模型强化学习仿真建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。