用大模型让机器人学会通用行为,无需重训就能快速适应新任务。
Behavior Foundation Model for Humanoid Robots
- 基于大规模行为数据训练生成式模型,捕捉可复用的机器人行为知识。
- 在仿真和真实机器人上均实现跨任务泛化与快速新行为学习。
- 适合需要灵活控制的复杂场景,如人形机器人自主操作。
人形机器人全身控制(WBC)在技能多样性方面取得显著进展,已广泛应用于行走、遥操作和运动追踪等场景。然而,现有框架仍高度依赖特定任务,严重依赖人工设计奖励函数,且跨任务泛化能力有限,难以响应任意控制模式,限制了其在复杂真实场景中的部署。为解决此问题,我们重新审视现有WBC系统,发现不同任务共享一个共同目标:生成引导机器人达到期望目标状态的适当行为。基于此洞察,我们提出行为基础模型(BFM),一种在大规模行为数据集上预训练的生成模型,以捕获适用于人形机器人的通用、可复用的行为知识。BFM结合掩码在线蒸馏框架与条件变分自编码器(CVAE),建模行为分布,从而实现对多种控制模式的灵活支持,并可在不从头训练的前提下高效获取新行为。大量仿真与物理平台实验表明,BFM在多样WBC任务中具有强泛化能力,并能快速适应新行为。这些结果确立了BFM作为通用人形机器人控制基础模型的潜力。
原文摘要 · Abstract (English)
Whole-body control (WBC) of humanoid robots has witnessed remarkable progress in skill versatility, enabling a wide range of applications such as locomotion, teleoperation, and motion tracking. Despite these achievements, existing WBC frameworks remain largely task-specific, relying heavily on labor-intensive reward engineering and demonstrating limited generalization across tasks and skills. These limitations hinder their response to arbitrary control modes and restrict their deployment in complex, real-world scenarios. To address these challenges, we revisit existing WBC systems and identify a shared objective across diverse tasks: the generation of appropriate behaviors that guide the robot toward desired goal states. Building on this insight, we propose the Behavior Foundation Model (BFM), a generative model pretrained on large-scale behavioral datasets to capture broad, reusable behavioral knowledge for humanoid robots. BFM integrates a masked online distillation framework with a Conditional Variational Autoencoder (CVAE) to model behavioral distributions, thereby enabling flexible operation across diverse control modes and efficient acquisition of novel behaviors without retraining from scratch. Extensive experiments in both simulation and on a physical humanoid platform demonstrate that BFM generalizes robustly across diverse WBC tasks while rapidly adapting to new behaviors. These results establish BFM as a promising step toward a foundation model for general-purpose humanoid control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。