arXiv:2505.20857cs.RO2025-05被引 4

用扩散模型统一适配不同机器人的动作迁移,解决结构差异难题。

Multi-Embodiment Robotic Retargeting via Guided Diffusion Model

  • 以图结构编码机器人拓扑与几何特征,实现跨体感统一建模。
  • 在无真实目标动作数据下,通过能量引导损失训练模型,实现跨体动作迁移。
  • 支持多样骨骼结构与相似动作泛化,适合多机器人动作移植场景。

从现有动作数据集为特定机器人进行动作迁移是将人类行为模式迁移到各类机器人并实现跨机器人传递的关键步骤。然而,不同机器人在拓扑结构、几何参数及关节对应关系上的不一致,使得难以构建统一的迁移架构。本文提出一种新型统一的图条件扩散生成框架,用于跨异构体感的动作迁移。通过图结构表征各类机器人的内在特性,有效捕捉其拓扑与几何特征;该图编码进一步支持基于定制注意力机制的关节级知识利用。针对目标体感缺乏真实动作数据的问题,采用基于能量的引导策略作为迁移损失来训练扩散模型。作为机器人领域首批跨体感动作迁移方法之一,实验验证了该模型能以统一方式实现异构体感间的动作迁移,并展现出对多样骨骼结构和相似动作模式的一定泛化能力。

原文摘要 · Abstract (English)

Motion retargeting for specific robot from existing motion datasets is one critical step in transferring motion patterns from human behaviors to and across various robots. However, inconsistencies in topological structure, geometrical parameters as well as joint correspondence make it difficult to handle diverse embodiments with a unified retargeting architecture. In this work, we propose a novel unified graph-conditioned diffusion-based motion generation framework for retargeting reference motions across diverse embodiments. The intrinsic characteristics of heterogeneous embodiments are represented with graph structure that effectively captures topological and geometrical features of different robots. Such a graph-based encoding further allows for knowledge exploitation at the joint level with a customized attention mechanisms developed in this work. For lacking ground truth motions of the desired embodiment, we utilize an energy-based guidance formulated as retargeting losses to train the diffusion model. As one of the first cross-embodiment motion retargeting methods in robotics, our experiments validate that the proposed model can retarget motions across heterogeneous embodiments in a unified manner. Moreover, it demonstrates a certain degree of generalization to both diverse skeletal structures and similar motion patterns.

动作迁移扩散模型多机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。