arXiv:2507.07356cs.RO2025-07被引 60

让人形机器人学会通用全身动作追踪,提升真实场景下的适应能力。

UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robots

  • 分三阶段训练:先用教师策略生成高质量动作,再用CVAE学通用学生策略,最后快速适配难追踪动作。
  • 在仿真和真实G1机器人上验证,对未见过的动作也能保持高精度跟踪。
  • 适合需要强泛化能力的复杂动作控制场景,如服务机器人或表演型人形机。

实现表达性强且泛化能力强的全身运动控制对人形机器人在真实环境中的部署至关重要。本文提出UniTracker,一种三阶段训练框架,可在多种人类行为下实现鲁棒、可扩展的动作追踪。第一阶段,利用特权观测训练教师策略生成高质量动作;第二阶段,引入条件变分自编码器(CVAE)建模通用学生策略,可直接部署于真实硬件。CVAE结构使策略学习全局运动隐表示,提升对未见行为的泛化能力,并克服标准MLP在部分观测下出现的姿态漂移问题。通过将部分观测先验与全观测编码器对齐,训练中融入全局意图。第三阶段,引入快速适配模块,对难以直接追踪的动作序列进行单个或批量微调,展现方法的灵活性与可扩展性。我们在仿真和真实世界中使用Unitree G1人形机器人评估UniTracker,结果表明其在动作多样性、跟踪精度和部署鲁棒性方面表现优异。

原文摘要 · Abstract (English)

Achieving expressive and generalizable whole-body motion control is essential for deploying humanoid robots in real-world environments. In this work, we propose UniTracker, a three-stage training framework that enables robust and scalable motion tracking across a wide range of human behaviors. In the first stage, we train a teacher policy with privileged observations to generate high-quality actions. In the second stage, we introduce a Conditional Variational Autoencoder (CVAE) to model a universal student policy that can be deployed directly on real hardware. The CVAE structure allows the policy to learn a global latent representation of motion, enhancing generalization to unseen behaviors and addressing the limitations of standard MLP-based policies under partial observations. Unlike pure MLPs that suffer from drift in global attributes like orientation, our CVAE-student policy incorporates global intent during training by aligning a partial-observation prior to the full-observation encoder. In the third stage, we introduce a fast adaptation module that fine-tunes the universal policy on harder motion sequences that are difficult to track directly. This adaptation can be performed both for single sequences and in batch mode, further showcasing the flexibility and scalability of our approach. We evaluate UniTracker in both simulation and real-world settings using a Unitree G1 humanoid, demonstrating strong performance in motion diversity, tracking accuracy, and deployment robustness.

人形机器人动作追踪泛化控制CVAE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。