arXiv:2603.19305cs.ROcs.AI2026-03被引 2

让机器人生成符合物理规律的复杂动作,直接落地真实执行。

PhyGile: Physics-Prefix Guided Motion Generation for Agile General Humanoid Motion Tracking

  • 用物理引导的前缀在推理时生成机器人本体动作
  • 实测可稳定执行高难度全身动作,超越走路等基础动作
  • 适合需要真实机器人控制的科研与工业场景

类人机器人需在真实环境中执行敏捷且富有表现力的全身动作。现有文本到动作生成模型主要基于人体运动数据集训练,其先验假设源于人类生物力学、驱动方式、质量分布和接触策略。当这些动作直接重定向至类人机器人时,轨迹虽满足几何约束(如关节极限和姿态连续性),外观也看似运动合理,但常违反实际执行所需的物理可行性。为此,本文提出 PhyGile,一个将机器人本体动作生成与通用运动追踪(GMT)闭环结合的统一框架。PhyGile 在推理时进行物理前缀引导的机器人本体动作生成,直接在 262 维骨骼空间中生成机器人本体动作,通过物理引导前缀消除推理时重定向带来的伪影,减少生成与执行间的偏差。在物理前缀适应前,采用基于课程学习的专家混合方案训练 GMT 控制器,并在无标签运动数据上进行后训练以增强对大规模机器人动作的鲁棒性。在物理前缀适应阶段,控制器进一步在物理衍生前缀下生成目标进行微调,使复杂动作能在真实机器人上实现敏捷且稳定的执行。大量离线与真实机器人实验表明,PhyGile 拓展了文本驱动类人控制的边界,实现了对远超步行和低动态动作的高难度全身动作的稳定追踪。

原文摘要 · Abstract (English)

Humanoid robots are expected to execute agile and expressive whole-body motions in real-world settings. Existing text-to-motion generation models are predominantly trained on captured human motion datasets, whose priors assume human biomechanics, actuation, mass distribution, and contact strategies. When such motions are directly retargeted to humanoid robots, the resulting trajectories may satisfy geometric constraints (e.g., joint limits and pose continuity) and appear kinematically reasonable. However, they frequently violate the physical feasibility required for real-world execution. To address these issues, we present PhyGile, a unified framework that closes the loop between robot-native motion generation and General Motion Tracking (GMT). PhyGile performs physics-prefix-guided robot-native motion generation at inference time, directly generating robot-native motions in a 262-dimensional skeletal space with physics-guided prefixes, thereby eliminating inference-time retargeting artifacts and reducing generation-execution discrepancies. Before physics-prefix adaptation, we train the GMT controller with a curriculum-based mixture-of-experts scheme, followed by post-training on unlabeled motion data to improve robustness over large-scale robot motions. During physics-prefix adaptation, the GMT controller is further fine-tuned with generated objectives under physics-derived prefixes, enabling agile and stable execution of complex motions on real robots. Extensive offline and real-robot experiments demonstrate that PhyGile expands the frontier of text-driven humanoid control, enabling stable tracking of agile, highly difficult whole-body motions that go well beyond walking and low-dynamic motions typically achieved by prior methods.

运动生成机器人控制物理模拟文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。