用物理与视觉对齐减少仿真到现实的差距,提升机器人训练效果。
EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modeling
- 通过可微分物理模块优化控制增益和摩擦系数,对齐仿真与真实动态。
- 生成逼真视频使任务成功率提升29.17%,显著缩小视觉差异。
- 适合需要高效训练机器人策略的研究者与开发者使用。
Embodied AI 的快速发展带来了对大规模高质量真实世界数据的巨大需求,但收集此类数据成本高昂且效率低下。因此,仿真环境成为训练机器人策略的重要替代方案。然而,真实与仿真之间的巨大差距仍是关键瓶颈,尤其体现在物理动力学和视觉外观方面。为此,我们提出 EmbodieDreamer,从物理和外观两方面缩小 Real2Sim2Real 差距。具体而言,提出 PhysAligner,一个可微分的物理模块,通过联合优化机器人特定参数(如控制增益、摩擦系数),使仿真动力学更贴近真实观测。此外,引入 VisAligner,结合条件视频扩散模型,将低质量仿真渲染转化为基于仿真状态的逼真视频,实现高保真视觉迁移。大量实验验证了该框架的有效性:PhysAligner 相比模拟退火方法将物理参数估计误差降低 3.74%,优化速度提升 89.91%。在生成的逼真环境中训练策略后,强化学习在真实任务中的平均成功率提升 29.17%。代码、模型与数据将公开发布。
原文摘要 · Abstract (English)
The rapid advancement of Embodied AI has led to an increasing demand for large-scale, high-quality real-world data. However, collecting such embodied data remains costly and inefficient. As a result, simulation environments have become a crucial surrogate for training robot policies. Yet, the significant Real2Sim2Real gap remains a critical bottleneck, particularly in terms of physical dynamics and visual appearance. To address this challenge, we propose EmbodieDreamer, a novel framework that reduces the Real2Sim2Real gap from both the physics and appearance perspectives. Specifically, we propose PhysAligner, a differentiable physics module designed to reduce the Real2Sim physical gap. It jointly optimizes robot-specific parameters such as control gains and friction coefficients to better align simulated dynamics with real-world observations. In addition, we introduce VisAligner, which incorporates a conditional video diffusion model to bridge the Sim2Real appearance gap by translating low-fidelity simulated renderings into photorealistic videos conditioned on simulation states, enabling high-fidelity visual transfer. Extensive experiments validate the effectiveness of EmbodieDreamer. The proposed PhysAligner reduces physical parameter estimation error by 3.74% compared to simulated annealing methods while improving optimization speed by 89.91\%. Moreover, training robot policies in the generated photorealistic environment leads to a 29.17% improvement in the average task success rate across real-world tasks after reinforcement learning. Code, model and data will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。