arXiv:2602.18707cs.RO2026-02

用少量真实数据修复仿真中的碰撞误差,提升机器人政策的现实迁移能力。

CLASH: Collision Learning via Augmented Sim-to-real Hybridization to Bridge the Reality Gap

  • 基于仿真数据预训练碰撞模型,再用少量真实数据微调参数。
  • 仅需10次真实碰撞样本,使仿真预测准确率显著提升,搜索效率提高42%-48%。
  • 适合需要高精度物理仿真的强化学习与模型控制任务。

仿真到现实的差距,尤其是接触密集动力学(如碰撞)的建模不准确,仍是部署仿真训练机器人策略的主要障碍。传统物理引擎常以计算速度为代价牺牲准确性,导致直接策略迁移失败。为此,我们提出碰撞学习增强型仿真-现实混合框架CLASH,通过数据高效的方式学习一个参数化冲击碰撞代理模型,并作为插件集成到标准仿真器中。CLASH首先在不完美仿真器(MuJoCo)上利用大规模模拟碰撞数据提炼基础模型,捕获可复用的物理先验。仅需少量真实碰撞数据(如10个样本),即可(i)进行梯度驱动的关键接触参数识别,(ii)采用小步长、早停止的微调策略,纠正残余仿真-现实差异,避免过拟合。最终的混合仿真器不仅提升了碰撞后预测精度,还使碰撞密集型CMA-ES搜索的实时时长减少42%-48%。我们证明,使用该混合仿真器获得的策略在真实世界中迁移更鲁棒,在序列推移任务中强化学习成功率翻倍,模型控制任务性能显著提升。

原文摘要 · Abstract (English)

The sim-to-real gap, particularly in the inaccurate modeling of contact-rich dynamics like collisions, remains a primary obstacle to deploying robot policies trained in simulation. Conventional physics engines often trade accuracy for computational speed, leading to discrepancies that prevent direct policy transfer. To address this, we introduce Collision Learning via Augmented Sim-to-real Hybridization (CLASH), a data-efficient framework that learns a parameter-conditioned impulsive collision surrogate model and integrates it as a plug-in module within a standard simulator. CLASH first distills a base model from an imperfect simulator (MuJoCo) using large-scale simulated collisions to capture reusable physical priors. Given only a handful of real collisions (e.g., 10 samples), it then (i) performs gradient-based identification of key contact parameters and (ii) applies small-step, early-stopped fine-tuning to correct residual sim-to-real mismatches while avoiding overfitting. The resulting hybrid simulator not only achieves higher post-impact prediction accuracy but also reduces the wall-clock time of collision-heavy CMA-ES search by 42-48% compared to MuJoCo. We demonstrate that policies obtained with our hybrid simulator transfer more robustly to the real world, doubling the success rate in sequential pushing tasks with reinforcement learning and significantly increase the task performance with model-based control.

仿真-现实碰撞建模机器人控制数据高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。