arXiv:2605.27724cs.ROcs.AI2026-05

用全身规划生成人形机器人行走与操作的仿真数据,提升模仿学习效果。

HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning

论文配图:HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
图 1 · 摘自论文原文
  • 基于少量示范,通过全身动作规划生成新状态下的稳定操作数据。
  • 在9个任务上生成大量高质量数据,使模型性能比仅用真实数据提升20%。
  • 适合研究人形机器人模仿学习的数据生成与策略训练者。

模仿学习是训练人形机器人实现行走与操作的有前景方法,但需要大量演示数据,而通过遥操作采集耗时且困难。现有数据生成算法可自动合成机械臂演示,但在人形机器人上效果不佳,因其高维复合动作空间包含手臂、腿部和躯干。本文提出HumanoidMimicGen,一种生成人形机器人行走与操作数据的方法。该方法从少量源示范中迁移接触丰富的全身技能至新状态,可泛化于物体位姿变化。通过交替融合单臂、双臂技能与全身运动规划,生成跨多样场景与布局的稳定、无碰撞数据。为评估该方法,我们引入一个包含九项多样化任务的新模拟基准。结果表明,HumanoidMimicGen能自动生成大规模数据集用于模仿学习,并支持系统性研究数据生成与策略学习决策对模型性能的影响。实验显示,与仅使用真实数据训练的策略相比,联合训练的全身视觉运动策略性能提升20%。

原文摘要 · Abstract (English)

Imitation learning is a promising approach for training humanoid robots to both walk and manipulate, but it requires a large number of demonstrations, which are time-intensive and difficult to collect via teleoperation. Existing data-generation algorithms can automatically synthesize demonstrations for manipulators, but they are ineffective on humanoids because their high-dimensional composite action spaces involve arms, legs, and torsos. We present HumanoidMimicGen, a method for generating humanoid legged loco-manipulation data. Our method adapts contact-rich whole-body skills from a handful of source demonstrations to new states, generalizing across changes in object pose. By interleaving these single- and dual-arm skills with whole-body locomotion and manipulation planning, the method generates stable, collision-free data across diverse scenes and layouts. To evaluate our approach, we introduce a new simulated loco-manipulation benchmark containing nine diverse tasks that test humanoid loco-manipulation capabilities. There, we demonstrate that HumanoidMimicGen automatically generates large datasets for imitation learning and enables a systematic study of how data generation and policy learning decisions impact model performance. We show that whole-body visuomotor policies co-trained with data generated by HumanoidMimicGen outperform those trained only on real-world data by 20%.

人形机器人模仿学习数据生成全身规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。