超大规模运动追踪模型让机器人实现自然全身动作控制。
SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control
- 用海量动作捕捉数据训练大模型,无需人工设计奖励函数。
- 模型参数达4200万,使用21000小时GPU算力,覆盖700小时动作数据。
- 支持实时导航、虚拟现实远程操控和视觉语言动作统一控制。
尽管千亿参数的通用模型已在数千张GPU上训练,但人形机器人控制领域尚未实现类似规模提升。当前神经控制器规模小、行为有限,且仅在少数GPU上训练。本文展示通过扩大模型容量、数据量与计算资源,可构建具备自然、鲁棒全身运动能力的通用型人形机器人控制器。将运动追踪定位为可扩展的任务,利用多样化动作捕捉数据提供密集监督,学习人类运动先验,避免人工奖励工程。我们构建了一个运动追踪基础模型,沿三个维度扩展:网络规模(120万至4200万参数)、数据量(超过1亿帧,来自700小时动作捕捉)以及计算量(21000 GPU小时)。除了验证规模带来的收益,还展示了下游应用:实现实时运动规划,连接运动追踪与导航等任务,实现自然交互控制;并建立统一标记空间,支持虚拟现实遥操作与视觉-语言-动作(VLA)模型共享单一策略。通过该接口,实现了自主驱动的全身体协调操作,包括手足精准定位。大规模运动追踪表现出良好特性:性能随计算资源与数据多样性持续提升,且能泛化至未见动作,确立大规模运动追踪作为人形机器人控制的实际基础。
原文摘要 · Abstract (English)
Despite the rise of billion-parameter foundation models trained across thousands of graphical processing units (GPUs), similar scaling gains have not been shown for humanoid control. Current neural controllers for humanoids remain modest in size, target a limited set of behaviors, and are trained on a handful of GPUs. We show that scaling model capacity, data, and compute yields a generalist humanoid controller capable of natural, robust whole-body movements. We position motion tracking as a scalable task for humanoid control, leveraging dense supervision from diverse motion-capture data to acquire human motion priors without manual reward engineering. We build a foundation model for motion tracking by scaling along three axes: network size (1.2M to 42M parameters), dataset volume (100M+ frames from 700 hours of motion capture), and compute (21k GPU hours). Beyond demonstrating the benefits of scale, we further show downstream utility through a real-time kinematic planner that bridges motion tracking to tasks such as navigation, enabling natural and interactive control, as well as a unified token space that supports virtual reality (VR) teleoperation and vision-language-action (VLA) models with a single policy. Through this interface, we demonstrate autonomous VLA-driven whole-body loco-manipulation requiring coordinated hand and foot placement. Scaling motion tracking exhibits favorable properties: performance improves steadily with compute and data diversity, and learned policies generalize to unseen motions, establishing motion tracking at scale as a practical foundation for humanoid control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。