arXiv:2602.23832cs.RO2026-02被引 7

让机器人稳定跟踪人类动作,避免漂浮穿透等物理错误。

OmniTrack: General Motion Tracking via Physics-Consistent Reference

  • 先用仿真生成符合物理规律的参考动作,再训练机器人跟踪
  • 真实世界测试中实现数小时稳定追踪,包括翻滚、倒立等高难度动作
  • 适合需要灵活响应用户输入的远程操控场景

从丰富的人类运动数据中学习运动追踪是实现人形机器人通用控制的基础任务,使其能执行多样化行为。然而,人类与机器人在形态和动力学上的差异,以及数据噪声,会导致参考动作中出现物理上不可行的伪影,如漂浮和穿模。在训练和执行过程中,这些伪影会引发遵循错误参考动作与保持机器人稳定性之间的矛盾,阻碍通用运动追踪策略的发展。为此,我们提出OmniTrack,一种将物理可行性与通用运动追踪显式解耦的通用追踪框架。第一阶段,通过仿真中的轨迹滚动,由一个特权泛化策略生成严格遵循机器人动力学的物理可行动作;第二阶段,训练通用控制策略以追踪这些物理可行动作,确保控制稳定且可迁移至真实机器人。实验表明,OmniTrack提升了追踪精度,并展现出对未见过动作的强大泛化能力。在真实世界测试中,该方法实现了长达数小时的一致且稳定的追踪,包括翻滚、倒立等复杂体操动作。此外,我们还证明了OmniTrack支持人式风格的稳定动态在线遥操作,凸显其对不同用户输入的鲁棒性与适应性。

原文摘要 · Abstract (English)

Learning motion tracking from rich human motion data is a foundational task for achieving general control in humanoid robots, enabling them to perform diverse behaviors. However, discrepancies in morphology and dynamics between humans and robots, combined with data noise, introduce physically infeasible artifacts in reference motions, such as floating and penetration. During both training and execution, these artifacts create a conflict between following inaccurate reference motions and maintaining the robot's stability, hindering the development of a generalizable motion tracking policy. To address these challenges, we introduce OmniTrack, a general tracking framework that explicitly decouples physical feasibility from general motion tracking. In the first stage, a privileged generalist policy generates physically plausible motions that strictly adhere to the robot's dynamics via trajectory rollout in simulation. In the second stage, the general control policy is trained to track these physically feasible motions, ensuring stable and coherent control transfer to the real robot. Experiments show that OmniTrack improves tracking accuracy and demonstrates strong generalization to unseen motions. In real-world tests, OmniTrack achieves hour-long, consistent, and stable tracking, including complex acrobatic motions such as flips and cartwheels. Additionally, we show that OmniTrack supports human-style stable and dynamic online teleoperation, highlighting its robustness and adaptability to varying user inputs.

运动追踪人形机器人物理一致性遥操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。