arXiv:2510.11258cs.ROcs.LG2025-10被引 14

仅用一次模拟演示,实现人形机器人通用移动抓取。

DemoHLM: From One Demonstration to Generalizable Humanoid Loco-Manipulation

  • 分层架构:底层统一躯体控制器+高层多任务抓取策略
  • 仿真数据驱动学习,真实机器人完成10项任务无误
  • 适合研究人形机器人自主交互与仿真到现实迁移

人形机器人在人类环境中的多功能交互依赖于移动抓取能力。尽管近年在全身控制方面取得进展,但移动抓取仍缺乏系统研究,常依赖硬编码任务或高成本实机数据,限制了自主性与泛化能力。本文提出DemoHLM框架,仅需一次模拟演示即可在真实人形机器人上实现通用移动抓取。该框架采用分层结构,集成低层通用全身控制器与高层多任务抓取策略。全身控制器将全身运动指令转化为关节力矩,支持全方位移动;抓取策略通过我们自研的数据生成与模仿学习流程在仿真中训练,利用闭环视觉反馈向控制器发出指令,完成复杂移动抓取任务。实验表明,合成数据量与策略性能正相关,验证了数据生成流程的有效性及方法的数据高效性。在配备RGB-D相机的Unitree G1机器人上进行的真实世界实验,成功实现了跨空间变化下10项移动抓取任务的稳定表现,证明了DemoHLM的仿真到现实迁移能力。

原文摘要 · Abstract (English)

Loco-manipulation is a fundamental challenge for humanoid robots to achieve versatile interactions in human environments. Although recent studies have made significant progress in humanoid whole-body control, loco-manipulation remains underexplored and often relies on hard-coded task definitions or costly real-world data collection, which limits autonomy and generalization. We present DemoHLM, a framework for humanoid loco-manipulation that enables generalizable loco-manipulation on a real humanoid robot from a single demonstration in simulation. DemoHLM adopts a hierarchy that integrates a low-level universal whole-body controller with high-level manipulation policies for multiple tasks. The whole-body controller maps whole-body motion commands to joint torques and provides omnidirectional mobility for the humanoid robot. The manipulation policies, learned in simulation via our data generation and imitation learning pipeline, command the whole-body controller with closed-loop visual feedback to execute challenging loco-manipulation tasks. Experiments show a positive correlation between the amount of synthetic data and policy performance, underscoring the effectiveness of our data generation pipeline and the data efficiency of our approach. Real-world experiments on a Unitree G1 robot equipped with an RGB-D camera validate the sim-to-real transferability of DemoHLM, demonstrating robust performance under spatial variations across ten loco-manipulation tasks.

人形机器人移动抓取仿真实现分层控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。