让机器人学会新抓取技能而不遗忘旧技能,避免反复训练
iManip: Skill-Incremental Learning for Robotic Manipulation
- 用时间回放机制保存旧技能记忆,防止学习新技能时遗忘
- 设计可扩展的PerceiverIO模型,支持新增动作模式
- 在RLBench平台上验证,新旧技能都能保持高准确率
构建基于RLBench基准的技能增量学习环境,探索传统增量方法在此场景下的表现。发现其因忽视机器人操作任务的时间性和动作复杂性,导致严重灾难性遗忘。为此提出iManip框架:首先设计时间回放策略以保持旧技能完整性;其次引入可扩展的PerceiverIO结构,通过可扩展权重的动作提示适配新技能中的动作原语。大量实验表明,该框架在技能增量学习中表现优异。代码与环境将开源。
原文摘要 · Abstract (English)
The development of a generalist agent with adaptive multiple manipulation skills has been a long-standing goal in the robotics community. In this paper, we explore a crucial task, skill-incremental learning, in robotic manipulation, which is to endow the robots with the ability to learn new manipulation skills based on the previous learned knowledge without re-training. First, we build a skill-incremental environment based on the RLBench benchmark, and explore how traditional incremental methods perform in this setting. We find that they suffer from severe catastrophic forgetting due to the previous methods on classification overlooking the characteristics of temporality and action complexity in robotic manipulation tasks. Towards this end, we propose an incremental Manip}ulation framework, termed iManip, to mitigate the above issues. We firstly design a temporal replay strategy to maintain the integrity of old skills when learning new skill. Moreover, we propose the extendable PerceiverIO, consisting of an action prompt with extendable weight to adapt to new action primitives in new skill. Extensive experiments show that our framework performs well in Skill-Incremental Learning. Codes of the skill-incremental environment with our framework will be open-source.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。