针对人形机器人长尾动作控制难题,提出能力对齐的专家策略框架。
Athena-WBC: Capability-Aligned Policy Experts for Long-Tail Humanoid Whole-Body Control

- 设计动态与平衡两类专家,优化目标聚焦轨迹跟踪与重力适应。
- 仅用少量专家即恢复训练集长尾动作,追踪效果优于基线。
- 适合需要高动态平衡控制的人形机器人研发者参考。
大规模人形机器人运动追踪控制器通常通过重新分配训练资源来提升性能:对困难动作增加采样频率、拆分到小集合或分配给专用专家。我们发现这种思路不完整。在强基线全身体控模型中,即使经过针对性训练,仍存在一组可行训练片段无法解决,尤其在高动态过渡和平衡关键动作上。这些失败不仅源于暴露不足,更源于动作需求与默认训练方案所诱导的有效能力不匹配。为此,我们提出Athena-WBC,一种紧凑的教师-学生架构,包含能力对齐的策略专家。动态专家采用聚焦跟踪、约束感知的目标函数,去除保守努力和时序控制惩罚,同时保留物理可行性约束;平衡专家使用重力课程以提升早期训练存活率。生成的特权教师通过DAgger蒸馏进行动作路由,并压缩为单一可部署控制器,随后经强化学习微调。在全尺寸人形机器人上的实验表明,该方法在仅使用少量专家的情况下,显著提升了训练集长尾动作的恢复能力,并在未见动作上实现了优于强基线SONIC方案的追踪表现。
原文摘要 · Abstract (English)
Large-scale humanoid motion-tracking controllers are commonly improved by reallocating training effort: difficult motions are sampled more often, isolated into smaller subsets, or assigned to specialized experts. We show that this view is incomplete. In strong whole-body-control baselines, a residual set of feasible training clips remains unsolved even under targeted training, especially for high-dynamic transitions and balance-critical motions. These failures arise not only from insufficient exposure, but from a mismatch between the motion demands and the effective capability induced by the default training recipe. We propose Athena-WBC, a compact teacher-student pipeline with capability-aligned policy experts for long-tail humanoid whole-body control. Dynamic experts use a tracking-focused, constraint-aware objective that removes conservative effort and temporal-control penalties while preserving physical feasibility constraints; balance experts use a gravity curriculum to improve early-training survivability. The resulting privileged teachers are motion-routed for DAgger distillation and then compressed into a single controller with deployable observations followed by RL fine-tuning. Experiments on a full-size humanoid show improved recovery of training-set long-tail motions and better held-out tracking than a strong SONIC-recipe baseline, using only a small number of experts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。