用大规模仿真训练人形机器人,直接零样本部署到真实硬件上。
VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation
- 通过师生框架在仿真中训练视觉控制策略
- 在64张GPU上训练,实现54次连续操作
- 无需实机微调,适用于多种场景变化
人形机器人在真实世界部署的关键障碍在于缺乏自主的运动与操作能力。本文提出VIRAL,一种全仿真训练的视觉模拟到现实迁移框架,可零样本部署至真实硬件。VIRAL采用教师-学生结构:特权强化学习教师基于完整状态信息,使用增量动作空间和参考状态初始化学习长时程运动操作;视觉学生策略通过大规模仿真中的分块渲染,结合在线DAgger与行为克隆方法进行蒸馏。我们发现计算规模至关重要:将仿真扩展至数十张GPU(最多64张)可使教师与学生训练稳定,而低算力环境常导致失败。为缩小模拟与现实差距,VIRAL结合了覆盖光照、材质、相机参数、图像质量及传感器延迟的大规模视觉域随机化,并对灵巧手与相机进行真实到仿真对齐。在Unitree G1人形机器人上部署的基于RGB的策略,实现了长达54个周期的连续运动操作,泛化至多样空间与外观变化,且无需任何实机微调,性能接近专家级遥操作水平。大量消融实验揭示了实现基于视觉的人形运动操作落地的关键设计选择。
原文摘要 · Abstract (English)
A key barrier to the real-world deployment of humanoid robots is the lack of autonomous loco-manipulation skills. We introduce VIRAL, a visual sim-to-real framework that learns humanoid loco-manipulation entirely in simulation and deploys it zero-shot to real hardware. VIRAL follows a teacher-student design: a privileged RL teacher, operating on full state, learns long-horizon loco-manipulation using a delta action space and reference state initialization. A vision-based student policy is then distilled from the teacher via large-scale simulation with tiled rendering, trained with a mixture of online DAgger and behavior cloning. We find that compute scale is critical: scaling simulation to tens of GPUs (up to 64) makes both teacher and student training reliable, while low-compute regimes often fail. To bridge the sim-to-real gap, VIRAL combines large-scale visual domain randomization over lighting, materials, camera parameters, image quality, and sensor delays--with real-to-sim alignment of the dexterous hands and cameras. Deployed on a Unitree G1 humanoid, the resulting RGB-based policy performs continuous loco-manipulation for up to 54 cycles, generalizing to diverse spatial and appearance variations without any real-world fine-tuning, and approaching expert-level teleoperation performance. Extensive ablations dissect the key design choices required to make RGB-based humanoid loco-manipulation work in practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。