arXiv:2409.13208cs.ROcs.AI2024-09中稿 · IROS 2024被引 1

用人体先验逆向生成机器人-人类姿态配对数据,提升动作迁移质量。

Redefining Data Pairing for Motion Retargeting Leveraging a Human Body Prior

  • 反向生成:先采样机器人姿态,再转为人类姿态。
  • 利用人体先验过滤极端姿态,确保数据高质量。
  • 适合需要高精度上身动作迁移的机器人研究者使用。

我们提出MR HuBo(Motion Retargeting leveraging a HUman BOdy prior),一种低成本、便捷的上身<机器人, 人类>姿态配对数据采集方法,对数据驱动的动作迁移至关重要。不同于现有方法将人类动捕姿态转换为机器人姿态,本方法逆向进行:先采样多样化的随机机器人姿态,再将其转换为人类姿态。由于随机机器人姿态可能导致极端或不可行的人体姿态,我们引入基于大量人体姿态数据训练的人体先验模型,用于筛选并去除异常姿态。该数据采集方法适用于任何类人机器人,只需调整尺寸缩放因子和关节角度范围等超参数。此外,我们还设计了一个两阶段运动迁移神经网络,可通过大量配对数据进行监督学习。实验表明,使用高质量配对数据训练的深度神经网络性能显著优于无监督学习方法;且经本方法过滤后的数据相比原始噪声数据,能带来更优的迁移效果。代码与视频结果见https://sites.google.com/view/mr-hubo/

原文摘要 · Abstract (English)

We propose MR HuBo(Motion Retargeting leveraging a HUman BOdy prior), a cost-effective and convenient method to collect high-quality upper body paired <robot, human> pose data, which is essential for data-driven motion retargeting methods. Unlike existing approaches which collect <robot, human> pose data by converting human MoCap poses into robot poses, our method goes in reverse. We first sample diverse random robot poses, and then convert them into human poses. However, since random robot poses can result in extreme and infeasible human poses, we propose an additional technique to sort out extreme poses by exploiting a human body prior trained from a large amount of human pose data. Our data collection method can be used for any humanoid robots, if one designs or optimizes the system's hyperparameters which include a size scale factor and the joint angle ranges for sampling. In addition to this data collection method, we also present a two-stage motion retargeting neural network that can be trained via supervised learning on a large amount of paired data. Compared to other learning-based methods trained via unsupervised learning, we found that our deep neural network trained with ample high-quality paired data achieved notable performance. Our experiments also show that our data filtering method yields better retargeting results than training the model with raw and noisy data. Our code and video results are available on https://sites.google.com/view/mr-hubo/

动作迁移姿态配对人体先验机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。