让机器人自动生成动作并实时优化追踪,无需额外数据收集。
GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking

- 在线交替训练生成器与追踪器,边执行边对齐
- 在真实机器人上实现更强语义对齐与零样本覆盖
- 适合需要快速部署、无需大量数据的机器人控制场景
通用类人机器人追踪器可执行多种参考动作,但其零样本覆盖依赖于成本高昂的具身数据集。文本到动作生成器提供可扩展监督,但基于人类动作或重定向数据训练的模型存在运动学合理性与机器人可执行性之间的差距。现有单向流程只能固定生成数据或奖励追踪器。本文提出GenTrack,一种在线生成器-追踪器框架,通过执行驱动的群体相对生成器对齐与新生成参考上的追踪器训练进行交替;锚定与回放机制抑制漂移。在Unitree G1上,我们使用ProtoMotions和SONIC主干网络,在三个零样本追踪任务(包括公开的AMASS和LAFAN基准,以及包含1,024个野外提示-动作对的私有分布外测试集)中评估GenTrack。在线联合训练策略持续提升生成动作的机器人可执行性与语义对齐度,同时显著扩大追踪器的零样本覆盖范围并提高追踪精度,尤其在分布外参考上表现突出。结果表明,联合在线后训练有效缩小了重定向参考与原生机器人动作间的可执行性差距,实现了无需额外数据采集的零样本类人控制,突破静态参考池的限制。
原文摘要 · Abstract (English)
General-purpose humanoid trackers can execute diverse references, but their zero-shot coverage depends on large embodied corpora that are costly to extend. Text-to-motion generators offer scalable supervision, yet models trained on human motion or retargeted data inherit a gap between kinematic plausibility and robot executability. Existing one-way pipelines fix either the generated corpus or the reward tracker. We introduce GenTrack, an online generator--tracker framework that alternates execution-grounded, group-relative generator alignment with tracker training on newly generated references; anchoring and rehearsal constrain drift. On Unitree G1, we evaluate GenTrack with ProtoMotions and SONIC backbones across three zero-shot tracking splits including public AMASS and LAFAN benchmarks, and a private out-of-distribution test set of 1,024 prompt-motion pairs in the wild. The online co-training strategy consistently produces generators that output more robot-executable motions with strong semantic alignment, and trackers with markedly broader zero-shot coverage and improved tracking accuracy, especially on out-of-distribution references. These results demonstrate that joint online post-training effectively narrows the executability gap between retargeted references and robot-native motion, advancing zero-shot humanoid control without additional data collection and beyond the limitations of a static reference pool.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。