arXiv:2506.12779cs.ROcs.LG2025-06NeurIPS被引 31

让人形机器人学会通用敏捷动作控制,一次训练覆盖多种行为。

From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots

  • 通过聚类分组相似动作,构建多个专家策略。
  • 结合仿真与真实数据迭代优化,提升泛化能力。
  • 最终融合为统一控制器,适合复杂多变任务场景。

由于运动需求多样及数据冲突,实现人形机器人通用敏捷全身控制仍是重大挑战。现有框架虽在特定动作上表现优异,但因控制需求矛盾和数据分布不一致,难以跨行为泛化。本文提出BumbleBee(BB)专家-通用学习框架,结合运动聚类与仿真到现实的适应机制。首先利用基于自编码器的聚类方法,根据运动特征与描述将行为相似的动作分组;在每组内训练专家策略,并通过迭代增量动作建模融合真实数据,弥合仿真与现实差距;最后将各专家策略提炼为统一的通用控制器,保持各类动作下的敏捷性与鲁棒性。在两个仿真环境及一台真实人形机器人上的实验表明,BB实现了当前最优的通用全身控制性能,为真实世界中敏捷、稳健且可泛化的机器人表现设立了新基准。

原文摘要 · Abstract (English)

Achieving general agile whole-body control on humanoid robots remains a major challenge due to diverse motion demands and data conflicts. While existing frameworks excel in training single motion-specific policies, they struggle to generalize across highly varied behaviors due to conflicting control requirements and mismatched data distributions. In this work, we propose BumbleBee (BB), an expert-generalist learning framework that combines motion clustering and sim-to-real adaptation to overcome these challenges. BB first leverages an autoencoder-based clustering method to group behaviorally similar motions using motion features and motion descriptions. Expert policies are then trained within each cluster and refined with real-world data through iterative delta action modeling to bridge the sim-to-real gap. Finally, these experts are distilled into a unified generalist controller that preserves agility and robustness across all motion types. Experiments on two simulations and a real humanoid robot demonstrate that BB achieves state-of-the-art general whole-body control, setting a new benchmark for agile, robust, and generalizable humanoid performance in the real world. The project webpage is available at https://beingbeyond.github.io/BumbleBee/.

人形机器人全身控制通用智能仿真到现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。