arXiv:2412.15166cs.ROcs.AI2024-12中稿 · ICRA被引 10

用数字人模型实现不同人形机器人间技能高效迁移。

Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration

  • 通过对抗性模仿学习人类动作,分解机器人结构分块训练。
  • 在5种不同配置人形机器人上实现稳定运动操作,降低数据需求。
  • 适合快速部署新机器人平台,尤其适合重复性劳动场景。

人形机器人被视作能执行多种人类级运动-操作任务的具身智能体,尤其适用于高强度、重复性劳动场景。然而,由于人形机器人自由度高,获取足够训练数据过程繁琐。随着新平台快速涌现,跨平台通用技能迁移框架日益关键。为此,我们提出一种可迁移框架:利用统一数字人模型作为通用原型,避免在每个新平台重新训练。该模型通过对抗性模仿从人类示范中学习行为基元,将复杂机器人结构分解为功能组件,各自独立训练并动态协调。任务泛化通过人-物交互图实现,技能通过特定于机体的运动重定向与动态微调转移至不同机器人。在五种配置各异的人形机器人上验证,均实现稳定运动-操作,显著减少数据需求,提升跨平台技能迁移效率。

原文摘要 · Abstract (English)

Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is challenging due to the high degrees of freedom of humanoid robots, and collecting sufficient training data for humanoid is a laborious process. Given the rapid introduction of new humanoid platforms, a cross-embodiment framework that allows generalizable skill transfer is becoming increasingly critical. To address this, we propose a transferable framework that reduces the data bottleneck by using a unified digital human model as a common prototype and bypassing the need for re-training on every new robot platform. The model learns behavior primitives from human demonstrations through adversarial imitation, and the complex robot structures are decomposed into functional components, each trained independently and dynamically coordinated. Task generalization is achieved through a human-object interaction graph, and skills are transferred to different robots via embodiment-specific kinematic motion retargeting and dynamic fine-tuning. Our framework is validated on five humanoid robots with diverse configurations, demonstrating stable loco-manipulation and highlighting its effectiveness in reducing data requirements and increasing the efficiency of skill transfer across platforms.

人形机器人技能迁移动作模仿多平台

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。