arXiv:2507.00917cs.RO2025-07综述被引 60

综述物理模拟器与世界模型如何协同提升机器人智能。

A Survey: Learning Embodied Intelligence from Physical Simulators and World Models

  • 结合物理仿真与内部世界模型,训练更自主的机器人。
  • 提升机器人在真实环境中的适应性与泛化能力。
  • 适合关注具身智能与机器人学习的研究者参考。

实现通用人工智能(AGI)使具身智能成为机器人研究的核心。具身智能强调智能体在物理世界中感知、推理与行动的能力。实现鲁棒的具身智能不仅需要先进的感知与控制,还需将抽象认知扎根于真实交互。物理模拟器与世界模型作为两项关键技术,正推动该领域发展。物理模拟器提供可控且高保真的训练与评估环境,支持复杂行为的安全高效开发;世界模型则赋予机器人对环境的内在表征,使其能进行预测性规划和超越直接感官输入的自适应决策。本文系统综述了通过融合物理模拟器与世界模型学习具身人工智能的最新进展,分析二者在增强自主性、适应性与泛化能力方面的互补作用,探讨外部仿真与内部建模之间的互动如何弥合仿真训练与真实部署间的差距。通过总结当前成果并识别开放挑战,本文旨在为构建更强大、更具泛化性的具身智能系统提供全面视角。我们还维护一个动态更新的文献与开源项目库:https://github.com/NJU3DV-LoongGroup/Embodied-World-Models-Survey。

原文摘要 · Abstract (English)

The pursuit of artificial general intelligence (AGI) has placed embodied intelligence at the forefront of robotics research. Embodied intelligence focuses on agents capable of perceiving, reasoning, and acting within the physical world. Achieving robust embodied intelligence requires not only advanced perception and control, but also the ability to ground abstract cognition in real-world interactions. Two foundational technologies, physical simulators and world models, have emerged as critical enablers in this quest. Physical simulators provide controlled, high-fidelity environments for training and evaluating robotic agents, allowing safe and efficient development of complex behaviors. In contrast, world models empower robots with internal representations of their surroundings, enabling predictive planning and adaptive decision-making beyond direct sensory input. This survey systematically reviews recent advances in learning embodied AI through the integration of physical simulators and world models. We analyze their complementary roles in enhancing autonomy, adaptability, and generalization in intelligent robots, and discuss the interplay between external simulation and internal modeling in bridging the gap between simulated training and real-world deployment. By synthesizing current progress and identifying open challenges, this survey aims to provide a comprehensive perspective on the path toward more capable and generalizable embodied AI systems. We also maintain an active repository that contains up-to-date literature and open-source projects at https://github.com/NJU3DV-LoongGroup/Embodied-World-Models-Survey.

具身智能世界模型物理模拟机器人学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。