arXiv:2503.03081cs.RO2025-03中稿 · CoRL被引 38

用低成本外骨骼采集真实场景数据,训练出可泛化的机器人模仿策略

AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons

  • 用低成本外骨骼系统收集真实环境演示数据
  • 仅用野外数据训练的策略性能媲美遥操作训练模型
  • 适合希望低成本扩展机器人学习能力的研究者

将机器人模仿学习推广至真实场景应用,需高效可扩展的示范数据采集方法。尽管遥操作有效,但依赖昂贵且僵化的机器人平台。野外示范是潜在替代方案,但现有设备存在局限:手持装置视角受限,全身系统常因领域差距需用机器人数据微调。为此,我们提出AirExo-2——一种低成本外骨骼系统,用于大规模野外数据采集,并配备多个适配器,将采集数据转化为适用于策略学习的伪机器人示范。我们还引入RISE-2,一种融合3D空间与2D语义感知的可泛化模仿学习策略。实验表明,RISE-2在同域和泛化评估中均优于现有最先进方法。仅基于AirExo-2生成的野外数据训练的RISE-2策略,性能与遥操作数据训练的模型相当,证明了AirExo-2在规模化、可泛化模仿学习中的有效性与潜力。

原文摘要 · Abstract (English)

Scaling up robotic imitation learning for real-world applications requires efficient and scalable demonstration collection methods. While teleoperation is effective, it depends on costly and inflexible robot platforms. In-the-wild demonstrations offer a promising alternative, but existing collection devices have key limitations: handheld setups offer limited observational coverage, and whole-body systems often require fine-tuning with robot data due to domain gaps. To address these challenges, we present AirExo-2, a low-cost exoskeleton system for large-scale in-the-wild data collection, along with several adaptors that transform collected data into pseudo-robot demonstrations suitable for policy learning. We further introduce RISE-2, a generalizable imitation learning policy that fuses 3D spatial and 2D semantic perception for robust manipulations. Experiments show that RISE-2 outperforms prior state-of-the-art methods on both in-domain and generalization evaluations. Trained solely on adapted in-the-wild data produced by AirExo-2, the RISE-2 policy achieves comparable performance to the policy trained with teleoperated data, highlighting the effectiveness and potential of AirExo-2 for scalable and generalizable imitation learning.

机器人模仿学习外骨骼数据采集泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。