用动态专家混合架构实现机器人持续学习,避免遗忘且高效迁移技能。
LiMoDE: Rethinking Lifelong Robot Manipulation from a Mixture-of-Dynamic-Experts Perspective

- 采用动态专家混合结构,根据动作信息激活不同专家应对短期任务。
- 在真实场景和模拟环境中均实现优异性能,仅增加少量可训练参数。
- 适合需要长期适应新任务的机器人系统,尤其擅长技能复用与融合。
构建能利用先验知识持续适应新任务的通用机器人仍是一大挑战。现有方法通过参数高效微调缓解灾难性遗忘,但难以提取可复用技能或有效建模技能间交互。近期工作尝试通过学习提示解决,本文提出从架构视角出发的终身动态专家混合(LiMoDE)模型,采用两阶段学习方案:首先在多任务预训练阶段引入动态专家混合结构,基于运动信息动态激活异构专家以处理短期操作;随后在任务适配阶段设计终身专家混合适配机制,学习新专家并动态组合冻结专家,促进知识迁移。在仿真终身学习基准和真实世界任务上进行评估,实验表明,该方法仅引入少量额外可训练参数与推理开销,即可实现卓越性能与强持续适应能力。
原文摘要 · Abstract (English)
Building a generalist robot that can leverage prior knowledge for continuous task adaptation remains a significant challenge. Previous works alleviate the catastrophic forgetting problem by parameter-efficient fine-tuning for single-task adaptation. However, they fail to extract reusable skills and model the interaction with other skills effectively. Recent works try to address these issues by learning prompts. Differently, this paper presents an architectural perspective on the Lifelong Mixture of Dynamic Experts (\textit{LiMoDE}), a novel two-stage learning scheme for lifelong robot manipulation. Specifically, a dynamic MoE structure is first proposed in the multi-task pre-training stage to learn prior knowledge, where a varied number of heterogeneous experts are activated based on the motion information to address different short-term manipulations. Subsequently, in the task adaptation stage, we design a lifelong MoE adaptation mechanism % (LiMoEAM) that learns lifelong experts and dynamically combines them with frozen ones for new tasks, facilitating the knowledge transfer during adaptation. The proposed \textit{LiMoDE} is evaluated on both the simulated lifelong learning benchmark and real-world tasks. Extensive experiments demonstrate its effectiveness in achieving superior performance and strong lifelong adaptation by introducing a moderate number of additional trainable parameters and inference overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。