arXiv:2606.27676cs.RO2026-06

分治式模仿学习让机器人同时稳走会动,无需全身动捕设备。

CWI: Composite Humanoid Whole-Body Imitation System for Loco-manipulation

论文配图:CWI: Composite Humanoid Whole-Body Imitation System for Loco-manipulation
图 1 · 摘自论文原文
  • 上肢用完整动作捕捉数据模仿人类操作,下肢用精选步行/蹲姿数据训练双判别器
  • 实测在仿真与真实机器人上实现稳定协同运动,支持仅靠双手位置与速度指令远程操控
  • 适合需要高效人机协作的具身智能研究者,尤其关注低成本高鲁棒性系统设计

让仿人机器人完成日常任务需协调稳定行走与灵活操作。现有全身体控方法面临挑战:纯指令采样训练易受稀疏奖励困扰,且上肢控制常偏离人类动作统计特性;而直接模仿全身动作捕捉数据则因数据集不平衡——大量行走轨迹过于激进,影响稳定性,需大量清洗与增强。为此,我们提出复合全身体控模仿(CWI)框架,将上肢操作与下肢行走解耦处理。上肢利用丰富多样的动作捕捉参考数据进行模仿,下肢则通过对抗性运动先验(AMP)训练双判别器,基于精选的专家级行走与蹲姿片段生成稳定运动。多判别器架构缓解了行走、操作与动作风格目标间的冲突,教师-学生蒸馏阶段最终得到仅依赖双手姿态及速度/高度指令的全身体控策略。在仿真与真实全尺寸LimX Oli机器人上的实验表明,CWI实现了竞争性行走-操作表现,具备强健的全身协调能力,并支持无需全身动捕的实用化远程操控。

原文摘要 · Abstract (English)

Achieving everyday tasks with humanoid robots requires coordinating stable locomotion with versatile manipulation. However, existing whole-body controllers still face significant challenges. Methods trained solely via command sampling, without motion-capture (MoCap) data, often struggle with sparse rewards and require carefully tuned curricula to converge. This is especially problematic for upper-body control, where the resulting motions deviate from human-like statistics and degrade whole-body coordination. Conversely, approaches that imitate full-body MoCap data suffer from dataset imbalance, as many locomotion trajectories are overly aggressive for stable-locomotion scenarios, necessitating extensive data filtering and augmentation. To address this, we present Composite Whole-Body Imitation (CWI), a framework that decouples the use of MoCap data for upper-body manipulation and lower-body locomotion. This decoupling allows us to exploit the full MoCap dataset of diverse manipulation references, while stable, command-conditioned lower-body locomotion is guided by dual discriminators trained on curated expert-quality walking and squatting clips via an Adversarial Motion Prior (AMP). A multi-critic architecture reduces conflicts among locomotion, manipulation, and motion-style objectives, and a teacher--student distillation stage yields a whole-body policy conditioned only on bimanual hand poses and velocity/height commands. We evaluate CWI through simulation experiments and real-world deployment on a full-size LimX Oli humanoid. The results show competitive loco-manipulation performance, robust whole-body coordination, and practical teleoperation without full-body motion-capture equipment. A project page with supplementary material can be found at https://cwi-ral.github.io/CWI-RAL-Webpage.

仿人机器人动作模仿协同控制远程操控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。