arXiv:2509.15443cs.ROcs.AI2025-09被引 5

用神经网络实现高效人形机器人全身动作迁移,解决数据噪声与计算慢问题。

A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting

  • 通过图卷积双自编码器将人体与人形机器人动作映射到共享隐空间
  • 每秒可处理超5000帧,且生成动作物理安全、无抖动
  • 适合大规模机器人动作数据生成与真实机器人部署

人类到人形机器人的模仿学习为缓解机器人领域严重的数据稀缺问题提供了新路径,可利用大量现有的人运动数据。但该范式面临两大挑战:一是视频、动捕或生成模型获取的人体数据常含空间噪声、抖动和帧级闪烁,这些在动作迁移过程中会被放大,导致机器人动作不安全或不可行;二是现有方法依赖逐帧数值优化,计算开销大,难以扩展。为此,本文提出隐式动力学动作重定向(IKMR),一种高度可扩展的神经数据转换管道。IKMR利用基于骨架的图卷积双自编码器,将跨结构的人体与人形机器人运动配置映射至共享拓扑隐空间。为确保生成动作的物理可行性,框架引入基于物理模拟的反馈精炼阶段,学习鲁棒动作先验。该隐式设计从根本上解决了上述问题:将计算负担从在线优化转为离线推理,使数据转换吞吐量超过5000帧/秒。此外,借助学习到的动作先验,系统具备内在数据净化能力,自然滤除高频噪声与空间抖动,生成平滑轨迹,保障物理硬件安全。大量评估,包括在真实人形机器人上的全身控制部署,证实IKMR成功弥合了人类动作与机器人数据之间的差距。

原文摘要 · Abstract (English)

Human-to-humanoid imitation learning presents a promising pathway to address the severe data scarcity bottleneck in robotics by utilizing abundant, large-scale human motion collections. However, scaling this paradigm requires addressing two key challenges. First, human motion data acquired from videos, motion capture systems, or generative models often contains spatial noise, jitter, and frame-level flickering, which can be amplified during retargeting and lead to unsafe or physically infeasible robot motions. Second, existing motion retargeting methods typically rely on frame-by-frame numerical optimization, making them too computationally expensive for large-scale dataset synthesis. To overcome these limitations, we introduce Implicit Kinodynamic Motion Retargeting (IKMR), a highly scalable, neural-based data transformation pipeline. IKMR leverages a skeleton-based graph convolutional dual autoencoder to map cross-structural human and humanoid kinematic configurations into a shared topological latent space. To guarantee the physical viability of the generated data, the framework incorporates a physics-informed refinement phase that utilizes simulated physical tracking feedback to learn a robust motion prior. This implicit formulation fundamentally resolves both challenges. By shifting the computational burden from online optimization to offline inference, IKMR achieves an unprecedented data conversion throughput exceeding 5000 frames per second. Furthermore, leveraging the learned motion prior, it functions as an intrinsic data curation mechanism and naturally filters out high-frequency noise and spatial jitters from source data, yielding smooth trajectories that ensure physical hardware safety. Extensive evaluations, including real-world whole-body control deployments on humanoid robot, confirm that IKMR bridges the gap between human motion and robotic data.

动作迁移人形机器人神经生成物理安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。