零样本迁移让机器人直接复现人类动作,无需调参。
ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control
- 用多源数据训练策略,零样本部署到真实机器人。
- 在模拟中训练,成功实现跨平台动态多接触动作。
- 适合想快速部署复杂动作的机器人研发者。
实现类人机器人在高动态、强接触行为中的鲁棒全肢体控制仍是核心挑战,传统方法需大量针对技能的工程设计与控制器调优。本文提出ZEST(零样本具身技能迁移),一种简化的运动模仿框架:通过强化学习从多样化来源——高保真动捕数据、噪声单目视频、非物理约束动画——训练策略,并零样本部署至硬件。ZEST在不依赖接触标签、参考/观测窗口、状态估计器及复杂奖励设计的前提下,实现跨行为与平台泛化。其训练流程结合自适应采样(聚焦困难动作段)与基于模型的辅助力矩自动课程,支持长时程动态操作。此外,提出从近似解析惯量值中选取关节增益的方法,以及改进的执行器模型。所有训练均在模拟中完成,采用适度领域随机化。ZEST在波士顿动力Atlas上成功学习动态多接触技能(如陆军爬行、街舞);直接从视频迁移表达性舞蹈与场景交互技能(如箱体攀爬)至Atlas与Unitree G1;并扩展至Spot四足机器人,通过动画实现连续后空翻等特技动作。结果表明,ZEST能鲁棒地跨异构数据源与机器人本体零样本部署,建立生物运动与机器人行为间可扩展的接口。
原文摘要 · Abstract (English)
Achieving robust, human-like whole-body control on humanoid robots for agile, contact-rich behaviors remains a central challenge, demanding heavy per-skill engineering and a brittle process of tuning controllers. We introduce ZEST (Zero-shot Embodied Skill Transfer), a streamlined motion-imitation framework that trains policies via reinforcement learning from diverse sources -- high-fidelity motion capture, noisy monocular video, and non-physics-constrained animation -- and deploys them to hardware zero-shot. ZEST generalizes across behaviors and platforms while avoiding contact labels, reference or observation windows, state estimators, and extensive reward shaping. Its training pipeline combines adaptive sampling, which focuses training on difficult motion segments, and an automatic curriculum using a model-based assistive wrench, together enabling dynamic, long-horizon maneuvers. We further provide a procedure for selecting joint-level gains from approximate analytical armature values for closed-chain actuators, along with a refined model of actuators. Trained entirely in simulation with moderate domain randomization, ZEST demonstrates remarkable generality. On Boston Dynamics' Atlas humanoid, ZEST learns dynamic, multi-contact skills (e.g., army crawl, breakdancing) from motion capture. It transfers expressive dance and scene-interaction skills, such as box-climbing, directly from videos to Atlas and the Unitree G1. Furthermore, it extends across morphologies to the Spot quadruped, enabling acrobatics, such as a continuous backflip, through animation. Together, these results demonstrate robust zero-shot deployment across heterogeneous data sources and embodiments, establishing ZEST as a scalable interface between biological movements and their robotic counterparts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。