arXiv:2510.01708cs.ROcs.AI2025-10被引 2

用多仿真器训练机器人,减少仿真到现实的差距

PolySim: Bridging the Sim-to-Real Gap for Humanoid Control via Multi-Simulator Dynamics Randomization

  • 在多个不同仿真引擎中并行训练控制器,实现动态层面的域随机化
  • 在MuJoCo上比IsaacSim基线成功率提升52.8%,仿真间误差显著降低
  • 无需微调即可直接部署到真实Unitree G1机器人,适合跨平台控制研究

基于人体模型的全身控制策略在仿真中训练时,常受仿真器归纳偏置影响,导致仿真与现实之间存在显著差异。为缓解这一问题,核心思路是联合多个异构仿真器训练策略,使控制器学习更泛化的动力学特性。为此,我们提出PolySim,一个集成多种异构仿真器的全身控制训练平台。PolySim可在单次训练中同时启动来自不同引擎的并行环境,实现动态级域随机化。理论上,该方法能获得比单仿真器训练更紧的仿真归纳偏置上界。实验表明,PolySim在仿真间评估中大幅降低运动跟踪误差;例如,在MuJoCo上相比IsaacSim基线执行成功率提升52.8%。此外,其训练策略可实现零样本部署至真实Unitree G1机器人,无需额外微调,验证了从仿真到现实的有效迁移。代码将在论文录用后开源。

原文摘要 · Abstract (English)

Humanoid whole-body control (WBC) policies trained in simulation often suffer from the sim-to-real gap, which fundamentally arises from simulator inductive bias, the inherent assumptions and limitations of any single simulator. These biases lead to nontrivial discrepancies both across simulators and between simulation and the real world. To mitigate the effect of simulator inductive bias, the key idea is to train policies jointly across multiple simulators, encouraging the learned controller to capture dynamics that generalize beyond any single simulator's assumptions. We thus introduce PolySim, a WBC training platform that integrates multiple heterogeneous simulators. PolySim can launch parallel environments from different engines simultaneously within a single training run, thereby realizing dynamics-level domain randomization. Theoretically, we show that PolySim yields a tighter upper bound on simulator inductive bias than single-simulator training. In experiments, PolySim substantially reduces motion-tracking error in sim-to-sim evaluations; for example, on MuJoCo, it improves execution success by 52.8 over an IsaacSim baseline. PolySim further enables zero-shot deployment on a real Unitree G1 without additional fine-tuning, showing effective transfer from simulation to the real world. We will release the PolySim code upon acceptance of this work.

仿真迁移机器人控制多仿真器零样本部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。