用分解与检索提升机器人学习效率,一天学会千个任务。
Learning a Thousand Tasks in a Day
- 将操作轨迹拆分为对齐和交互两阶段,结合检索实现高效学习。
- 仅需单次示范即可掌握新任务,数据效率比传统方法高一个数量级。
- 适合快速部署多任务机器人,尤其适用于真实世界场景的泛化需求。
人类能高效从示范中学习任务,但当前机器人模仿学习通常需数百甚至上千次示范。本文研究两种关键先验:将操作轨迹分解为顺序对齐与交互阶段,以及基于检索的泛化。通过3,450次真实世界实验,系统评估该分解策略。对比不同设计选择,发现检索在对齐与交互阶段均优于行为克隆。基于此,提出多任务轨迹迁移(MT3)方法,仅需每任务一次示范即可学习日常操作,并泛化至新物体。该效率使机器人在24小时内完成1,000个不同任务的教学。额外2,200次真实实验揭示了其在不同任务类别中的能力与局限。视频见https://www.robot-learning.uk/learning-1000-tasks。
原文摘要 · Abstract (English)
Humans are remarkably efficient at learning tasks from demonstrations, but today's imitation learning methods for robot manipulation often require hundreds or thousands of demonstrations per task. We investigate two fundamental priors for improving learning efficiency: decomposing manipulation trajectories into sequential alignment and interaction phases, and retrieval-based generalisation. Through 3,450 real-world rollouts, we systematically study this decomposition. We compare different design choices for the alignment and interaction phases, and examine generalisation and scaling trends relative to today's dominant paradigm of behavioural cloning with a single-phase monolithic policy. In the few-demonstrations-per-task regime (<10 demonstrations), decomposition achieves an order of magnitude improvement in data efficiency over single-phase learning, with retrieval consistently outperforming behavioural cloning for both alignment and interaction. Building on these insights, we develop Multi-Task Trajectory Transfer (MT3), an imitation learning method based on decomposition and retrieval. MT3 learns everyday manipulation tasks from as little as a single demonstration each, whilst also generalising to novel object instances. This efficiency enables us to teach a robot 1,000 distinct everyday tasks in under 24 hours of human demonstrator time. Through 2,200 additional real-world rollouts, we reveal MT3's capabilities and limitations across different task families. Videos of our experiments can be found on at https://www.robot-learning.uk/learning-1000-tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。