arXiv:2504.15561cs.ROcs.LG2025-04被引 11

提出可动态学习与复用技能的机器人连续模仿学习框架。

SPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulation

  • 构建分层架构,通过技能提示动态提取与选择操作技能
  • 在多个任务上优于现有方法,实现双向知识迁移
  • 适合需要长期适应新任务的机器人操作场景

现实世界中的机器人操作需在动态非结构化环境中具备持续适应能力。传统模仿学习依赖静态训练,难以支持长期演化。尽管连续模仿学习(CIL)能增量适应新任务并保留已有知识,但现有方法多忽略机器人操作的内在技能特性,或依赖人工定义的固定技能,导致跨任务知识迁移效果不佳。为此,本文提出基于技能提示的分层连续模仿学习(SPECI),一种面向机器人操作的端到端分层CIL策略架构。SPECI包含多模态感知与融合模块、高层技能推理模块和底层动作执行模块。通过可扩展的技能代码本与注意力驱动的技能选择机制,实现技能级与任务级的高效知识迁移。此外,引入模式近似以增强后两个模块的任务特定与共享参数,提升任务级知识迁移能力。在多样化的操作任务集上进行的大量实验表明,SPECI在所有评估指标上均持续优于当前最优的CIL方法,展现出卓越的双向知识迁移能力和整体性能。

原文摘要 · Abstract (English)

Real-world robot manipulation in dynamic unstructured environments requires lifelong adaptability to evolving objects, scenes and tasks. Traditional imitation learning relies on static training paradigms, which are ill-suited for lifelong adaptation. Although Continual Imitation Learnin (CIL) enables incremental task adaptation while preserving learned knowledge, current CIL methods primarily overlook the intrinsic skill characteristics of robot manipulation or depend on manually defined and rigid skills, leading to suboptimal cross-task knowledge transfer. To address these issues, we propose Skill Prompts-based HiErarchical Continual Imitation Learning (SPECI), a novel end-to-end hierarchical CIL policy architecture for robot manipulation. The SPECI framework consists of a multimodal perception and fusion module for heterogeneous sensory information encoding, a high-level skill inference module for dynamic skill extraction and selection, and a low-level action execution module for precise action generation. To enable efficient knowledge transfer on both skill and task levels, SPECI performs continual implicit skill acquisition and reuse via an expandable skill codebook and an attention-driven skill selection mechanism. Furthermore, we introduce mode approximation to augment the last two modules with task-specific and task-sharing parameters, thereby enhancing task-level knowledge transfer. Extensive experiments on diverse manipulation task suites demonstrate that SPECI consistently outperforms state-of-the-art CIL methods across all evaluated metrics, revealing exceptional bidirectional knowledge transfer and superior overall performance.

机器人操作连续学习技能迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。