arXiv:2502.01143cs.ROcs.AI2025-02被引 251

通过补偿仿真与现实动力学差异,让仿人机器人实现更敏捷的全身动作。

ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills

  • 分两阶段训练:先在仿真中预训练动作,再用真实数据学习残差动作补偿
  • 在真实机器人上将追踪误差降低,比传统方法更灵活、更敏捷
  • 适合希望提升仿人机器人真实世界表现的研究者和工程师

仿人机器人具备执行类人全身动作的巨大潜力,但因仿真与现实间动力学不匹配,实现敏捷协调的全身运动仍具挑战。现有方法如系统辨识(SysID)和领域随机化(DR)通常依赖繁重参数调优,或导致过于保守的策略而牺牲敏捷性。本文提出ASAP(Aligning Simulation and Real-World Physics),一种两阶段框架,以解决动力学失配问题并实现敏捷的全身技能。第一阶段在仿真中使用重定向的人体运动数据预训练动作跟踪策略;第二阶段将策略部署至真实世界,收集真实数据,训练一个残差动作模型以补偿动力学差异。随后,将该残差模型集成至仿真器中,对预训练策略进行微调,有效对齐真实世界动力学。我们在三个迁移场景中评估:IsaacGym到IsaacSim、IsaacGym到Genesis,以及IsaacGym到真实世界的Unitree G1仿人机器人。结果表明,ASAP显著提升了多种动态动作的敏捷性和全身协调性,相比SysID、DR及残差动力学学习基线,追踪误差更低。该方法使此前难以实现的高敏捷动作成为可能,展示了残差动作学习在弥合仿真与现实差距方面的潜力,为发展更具表现力和敏捷性的仿人机器人提供了有前景的模拟到现实路径。

原文摘要 · Abstract (English)

Humanoid robots hold the potential for unparalleled versatility in performing human-like, whole-body skills. However, achieving agile and coordinated whole-body motions remains a significant challenge due to the dynamics mismatch between simulation and the real world. Existing approaches, such as system identification (SysID) and domain randomization (DR) methods, often rely on labor-intensive parameter tuning or result in overly conservative policies that sacrifice agility. In this paper, we present ASAP (Aligning Simulation and Real-World Physics), a two-stage framework designed to tackle the dynamics mismatch and enable agile humanoid whole-body skills. In the first stage, we pre-train motion tracking policies in simulation using retargeted human motion data. In the second stage, we deploy the policies in the real world and collect real-world data to train a delta (residual) action model that compensates for the dynamics mismatch. Then, ASAP fine-tunes pre-trained policies with the delta action model integrated into the simulator to align effectively with real-world dynamics. We evaluate ASAP across three transfer scenarios: IsaacGym to IsaacSim, IsaacGym to Genesis, and IsaacGym to the real-world Unitree G1 humanoid robot. Our approach significantly improves agility and whole-body coordination across various dynamic motions, reducing tracking error compared to SysID, DR, and delta dynamics learning baselines. ASAP enables highly agile motions that were previously difficult to achieve, demonstrating the potential of delta action learning in bridging simulation and real-world dynamics. These results suggest a promising sim-to-real direction for developing more expressive and agile humanoids.

仿人机器人仿真迁移动力学对齐全身控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。