无需配对数据,将人动捕动作精准迁移到人形机器人
Human2Humanoid: Physics-Aware Cross-Morphology Motion Retargeting for Humanoid Robots

- 用图卷积网络捕捉骨骼拓扑特征,跨形态迁移更准确
- 通过末端执行器一致性损失,保持动作语义在不同体型间一致
- 引入物理可行性约束,减少落地错位等不自然现象
将人类动作迁移到人形机器人对远程操作、模仿学习和人机交互至关重要。但因人体与机器人在骨骼结构、肢体比例和自由度上差异显著,且缺乏成对运动数据,该任务仍具挑战性。本文提出 Human2Humanoid,一种无监督运动迁移框架,可在无配对数据条件下高保真地将人类动作转换为机器人行为。为弥合非配对数据下的域差距,采用基于 CycleGAN 的架构并结合骨架感知的图卷积网络以捕捉依赖拓扑的运动特征;为解决跨域尺度差异,引入形态不变的末端执行器一致性损失,对齐归一化后的末端轨迹以保持动作语义一致性;为提升物理合理性并减少接触伪影,显式施加物理感知可行性约束,鼓励复现源动作中的接触模式。实验表明,该方法成功将人类动作迁移到 Unitree G1 人形机器人,且在下游可控制性与物理可行性方面优于现有方法。
原文摘要 · Abstract (English)
Retargeting human motion to humanoid robots is critical for teleoperation, imitation learning and human-robot interaction. However, it remains challenging because of substantial morphological discrepancies between humans and robots, including differences in skeletal topology, limb proportions and degrees of freedom, as well as the scarcity of paired motion data. This paper presents Human2Humanoid, an unsupervised motion retargeting framework that transfers human motions to humanoid robot behaviors with high fidelity. To bridge the domain gap under unpaired data, we adopt a CycleGAN-based architecture equipped with a skeleton-aware graph convolutional network to capture topology-dependent motion features. To address cross-domain scale mismatches, we introduce a morphology-invariant end-effector consistency loss that aligns normalized end-effector trajectories to preserve motion semantics across embodiments. To improve physical plausibility and reduce contact artifacts, we impose explicit physics-aware feasibility constraints to encourage reproduction of the contact patterns in the source motion. Experimental results show that the proposed method successfully retargets human motion to the Unitree G1 humanoid robot without paired data, and outperforms existing methods in both downstream controllability and physical feasibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。