arXiv:2606.08548cs.RO2026-06

用仿真数据训练人形机器人,零样本部署成功率超真实数据。

OASIS: From Simulation Data Collection to Real-World Humanoid Loco-Manipulation

论文配图:OASIS: From Simulation Data Collection to Real-World Humanoid Loco-Manipulation
图 1 · 摘自论文原文
  • 用3D生成模型从真实图像重建物体资产,实现仿真环境高保真。
  • 仿真数据经域随机化增强,覆盖多样光照与环境变化。
  • 在真实机器人上零样本测试,多数任务成功率达最优。

近期机器人操作进展主要依赖大规模示范学习。对于人形机器人运动-操作任务,现有数据源在轨迹质量与可扩展性之间存在权衡:真实遥控采集轨迹质量高,但需专用场地且重置耗时;仿真则可在无硬件条件下大规模生成对齐本体的干净数据。本文提出OASIS,一种基于仿真数据的人形机器人运动-操作框架。OASIS通过3D生成模型自动从真实图像重建逼真物体资产,随后在仿真中通过遥控收集轨迹,并在后处理阶段施加多种域随机化进行增强。基于该仿真数据,我们设计了分层视觉-运动策略。大量真实人形机器人实验表明,该策略在零样本部署下,在多数任务上的成功率高于使用真实机器人遥控行为训练的策略,主要得益于仿真渲染所覆盖的丰富光照与环境变化,而真实数据难以捕捉这些差异。项目页面见https://oasis-humanoid.github.io/。

原文摘要 · Abstract (English)

Recent progress in robot manipulation has been largely driven by learning from large-scale demonstrations. For humanoid robot loco-manipulation tasks, however, existing data sources force an unsatisfying tradeoff between trajectory quality and scalability. Real-world teleoperation provides the highest-quality trajectories but requires dedicated physical space and time-consuming scene resets. Simulation offers an alternative way out of this dilemma: it can produce clean, embodiment-aligned data at scale without any physical hardware. In this paper, we propose OASIS, a simulation-data-driven framework for humanoid loco-manipulation. OASIS automatically reconstructs realistic object assets from real-world images using a 3D generative model. Based on these assets, trajectories are first collected through teleoperation in simulation, and then augmented under diverse domain randomizations in a post-processing stage. With the resulting simulation data, we further design a hierarchical visuomotor policy for humanoid loco-manipulation. Extensive experiments on the real humanoid robot show that, under zero-shot deployment, the policy trained on our simulation data achieves higher success rates on most tasks than that trained on real-robot teleoperation data, owing largely to the broad lighting and environmental variations covered by our simulation rendering, which real-robot data fails to capture. The project page is available at https://oasis-humanoid.github.io/.

人形机器人仿真训练视觉运动零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。