将人体动作模仿转化为可复用的混合运动先验,提升人形机器人行走泛化能力
Learning Reusable Hybrid Motion Priors for Humanoid Locomotion from Motion Imitation

- 通过三阶段流程将动作捕捉数据转为冻结的混合运动先验(HMP)
- 在仿真中实现速度跟踪、导航与跌倒恢复,真实机器人成功部署
- 代码本结构可解释,旋转技巧提升潜在空间组织性,减少摔倒
强化学习能生成鲁棒的人形机器人控制器,但每个新任务通常需独立训练策略并设计奖励函数。动作模仿通过训练策略追踪重定向的人体动作捕捉片段,提供另一种运动能力来源,但所得控制器仅为参考轨迹跟踪器,无法直接作为任务策略使用。本文提出一种三阶段流程,将动作模仿技能转化为可复用的混合运动先验(HMP)用于人形机器人行走。首先训练一个专家策略以模仿重定向的人体动作捕捉片段;其次将专家策略蒸馏为由本体感知编码器、残差向量量化(RVQ)代码本和动作解码器组成的冻结架构;最后,任务级策略通过选择代码本中的离散条目来解决行走任务,而HMP保持冻结。我们在仿真中评估了速度跟踪、点目标导航和跌倒恢复速度跟踪任务,并将速度跟踪策略部署于真实单位树G1机器人上。蒸馏过程保留了专家的追踪行为,且生成的HMP可无需重新训练作为不同下游行走策略的动作接口。学习到的HMP揭示了可解释的代码本结构,其中激活的RVQ层级数量调节可用步态模式。我们进一步证明,使用旋转技巧训练代码本可改善潜在空间组织性,相比标准直通估计器,显著降低下游任务中的跌倒率。
原文摘要 · Abstract (English)
Reinforcement learning can produce robust humanoid controllers, but each new task is typically trained as a separate policy with its own reward design and training process. Motion imitation provides an alternative source of motor competence by training policies to track retargeted human motions, yet the resulting controllers remain reference trackers and are not directly usable as task policies. We propose a three-stage pipeline that turns motion-imitation skills into a reusable hybrid motion prior (HMP) for humanoid locomotion. First, an expert policy is trained to imitate retargeted human motion-capture clips. Second, the expert is distilled into a frozen architecture composed of a proprioceptive encoder, a residual vector-quantized (RVQ) codebook, and an action decoder. Third, task-level policies are trained to solve locomotion tasks by selecting discrete codebook entries while the HMP remains frozen. We evaluate the method on velocity tracking, point-goal navigation, and fall-recovery velocity tracking in simulation, and deploy the velocity-tracking policy on a real Unitree G1 robot. The distillation process preserves the tracking behavior of the expert, while the resulting HMP can be reused without retraining as the action interface for different downstream locomotion policies. The learned HMP reveals an interpretable codebook structure in which the number of active RVQ stages modulates the available gait patterns. We further show that training the codebook with the rotation trick improves latent organization and reduces downstream falls compared with a standard straight-through estimator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。