arXiv:2410.19693cs.ROcs.AI2024-10CoRL被引 14

仅用一次示范和一次重置,自监督实现高效模仿学习

MILES: Making Imitation Learning Easy with Self-Supervision

  • 自监督数据收集:自动返回并复现单次示范
  • 仅需1次示范+1次重置,性能超越现有强化学习方法
  • 适合需要精细操作的现实任务,如钥匙开锁

模仿学习中的数据采集通常依赖大量人工标注示范和频繁环境重置。本文提出MILES:一种完全自主、自监督的数据采集范式,可仅凭一次示范和一次环境重置,实现高效策略学习。MILES在数据采集过程中自我引导,自主学习返回并跟随单一示范的策略,无需额外人工干预。我们在多个真实世界任务中评估了MILES,包括需要精确接触式操作的任务(如用钥匙开锁)。结果表明,在仅允许一次示范且不重复重置环境的约束下,MILES显著优于当前最先进的基于强化学习的模仿学习方法。实验视频与代码见:www.robot-learning.uk/miles。

原文摘要 · Abstract (English)

Data collection in imitation learning often requires significant, laborious human supervision, such as numerous demonstrations, and/or frequent environment resets for methods that incorporate reinforcement learning. In this work, we propose an alternative approach, MILES: a fully autonomous, self-supervised data collection paradigm, and we show that this enables efficient policy learning from just a single demonstration and a single environment reset. MILES autonomously learns a policy for returning to and then following the single demonstration, whilst being self-guided during data collection, eliminating the need for additional human interventions. We evaluated MILES across several real-world tasks, including tasks that require precise contact-rich manipulation such as locking a lock with a key. We found that, under the constraints of a single demonstration and no repeated environment resetting, MILES significantly outperforms state-of-the-art alternatives like imitation learning methods that leverage reinforcement learning. Videos of our experiments and code can be found on our webpage: www.robot-learning.uk/miles.

模仿学习自监督机器人操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。