用人类动作数据训练非人形机器人的运动能力,实现跨形态通用控制。
X-Morph: Human Motion Priors for Scalable Robot Learning Across Morphologies

- 将人类动作转换为适配多种机器人形态的运动参考
- 在四足、六足及带机械臂四足机上成功部署并跟踪复杂动作
- 支持视频遥控、文本生成等下游应用,适合机器人快速开发
近期类人机器人行为模型的发展很大程度依赖于丰富的真人动作数据,但非类人腿式机器人(如四足、六足、带机械臂四足机器人)缺乏类似数据。一种可行方案是复用人类动作数据,但直接迁移常导致动作视觉合理却物理不一致或难以追踪。本文提出X-Morph,一个将人类动作转化为多样非人形腿式机器人可部署的行走与动捕策略的流程。通过跨形态动作重定向阶段生成符合运动学、保留意图的机器人参考轨迹,再由特权强化学习策略进行跟踪,并蒸馏为因果性学生策略。我们在三类不同形态平台(四足、六足、带机械臂四足)上评估,结果表明生成策略能有效跟踪多样化重定向动作,泛化至未见人类动作,并支持视频遥操作、行为先验控制和文本条件动作生成等下游任务。这表明大规模人类动作数据可作为非类人机器人通用行为先验的基础。项目页:https://maker-rat.github.io/morph/
原文摘要 · Abstract (English)
Recent progress in humanoid behavior models has been driven in large part by abundant human motion data, but comparable motion data is scarce for non-humanoid legged robots such as quadrupeds, hexapods, and quadruped manipulators. A promising alternative is to repurpose human motion across embodiments; however, direct retargeting often produces motions that are visually plausible yet physically inconsistent or difficult to track under robot dynamics. We present X-Morph, a human-motion-to-robot-behavior pipeline that converts human motion into deployable locomotion and loco-manipulation policies for diverse non-humanoid legged morphologies. A cross-morphology retargeting stage converts human motions into kinematically plausible, intent-preserving robot references, which are then tracked by a privileged RL policy and distilled into a causal student policy. We evaluate X-Morph on three morphologically distinct platforms: a quadruped, a hexapod, and a quadruped equipped with a manipulator. The resulting policies track diverse retargeted motions, generalize to unseen human motions, and support downstream use cases including video-based teleoperation, behavior-prior control, and text-conditioned motion generation. These results suggest that large-scale human motion can serve as a substrate for learning broad, reusable behavior priors beyond humanoid robots. Project page: https://maker-rat.github.io/morph/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。