让机器人从演示中持续学习可复用技能,提升任务适应效率。
Incremental Learning of Retrievable Skills For Efficient Continual Task Adaptation
- 通过原型记忆检索状态对应的可复用技能
- 在Franka-Kitchen和Meta-World上实现高效任务适应
- 适合需要持续学习与快速迁移的机器人应用
持续模仿学习(CiL)旨在从多阶段、多任务的演示中提取并累积任务知识,以构建多任务策略。近年来,基于适配器的CiL方法因其参数高效性而受到关注,但其将各任务参数隔离,限制了不同演示间的知识共享。本文提出IsCiL框架,通过增量学习可共享技能,克服该局限。演示被映射到状态嵌入空间,利用基于原型的记忆系统,在输入状态时检索相应技能,并在对应适配器上增量学习。在Franka-Kitchen和Meta-World复杂任务上的实验表明,IsCiL在任务适应性和样本效率方面均表现稳健。此外,本文还展示了一个简单的扩展,支持任务遗忘场景。
原文摘要 · Abstract (English)
Continual Imitation Learning (CiL) involves extracting and accumulating task knowledge from demonstrations across multiple stages and tasks to achieve a multi-task policy. With recent advancements in foundation models, there has been a growing interest in adapter-based CiL approaches, where adapters are established parameter-efficiently for tasks newly demonstrated. While these approaches isolate parameters for specific tasks and tend to mitigate catastrophic forgetting, they limit knowledge sharing among different demonstrations. We introduce IsCiL, an adapter-based CiL framework that addresses this limitation of knowledge sharing by incrementally learning shareable skills from different demonstrations, thus enabling sample-efficient task adaptation using the skills particularly in non-stationary CiL environments. In IsCiL, demonstrations are mapped into the state embedding space, where proper skills can be retrieved upon input states through prototype-based memory. These retrievable skills are incrementally learned on their corresponding adapters. Our CiL experiments with complex tasks in Franka-Kitchen and Meta-World demonstrate robust performance of IsCiL in both task adaptation and sample-efficiency. We also show a simple extension of IsCiL for task unlearning scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。