提出分层任务感知的LoRA专家混合模型,解决智能体持续学习中的遗忘问题。
Hierarchical-Task-Aware Multi-modal Mixture of Incremental LoRA Experts for Embodied Continual Learning
- 分高阶指令与低阶动作两层,用嵌入聚类实现任务识别
- 双路由机制选择任务级与词元级的LoRA专家,减少遗忘率23.6%以上
- 结合奇异值分解保留旧任务关键参数,适合长期学习的机器人应用
以往具身智能的持续学习设置主要聚焦于基于人类指令执行低层动作,忽视了高层规划与多层级知识的学习。为此,我们提出分层具身持续学习框架(HEC),将智能体的持续学习过程分为高阶指令和低阶动作两个层次,并定义了五个具身持续学习子设置。在此基础上,引入任务感知增量式LoRA专家混合方法(Task-aware MoILE)。该方法通过聚类视觉-文本嵌入实现任务识别,并采用任务级路由与词元级路由双重机制,选择合适的LoRA专家。为有效缓解灾难性遗忘,对先前任务的LoRA参数进行奇异值分解(SVD),保留关键成分的同时正交训练剩余部分。实验表明,本方法在减少旧任务遗忘方面显著优于其他方法,有效支持智能体在持续学习新任务时保留已有知识。
原文摘要 · Abstract (English)
Previous continual learning setups for embodied intelligence focused on executing low-level actions based on human commands, neglecting the ability to learn high-level planning and multi-level knowledge. To address these issues, we propose the Hierarchical Embodied Continual Learning Setups (HEC) that divide the agent's continual learning process into two layers: high-level instructions and low-level actions, and define five embodied continual learning sub-setups. Building on these setups, we introduce the Task-aware Mixture of Incremental LoRA Experts (Task-aware MoILE) method. This approach achieves task recognition by clustering visual-text embeddings and uses both a task-level router and a token-level router to select the appropriate LoRA experts. To effectively address the issue of catastrophic forgetting, we apply Singular Value Decomposition (SVD) to the LoRA parameters obtained from prior tasks, preserving key components while orthogonally training the remaining parts. The experimental results show that our method stands out in reducing the forgetting of old tasks compared to other methods, effectively supporting agents in retaining prior knowledge while continuously learning new tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。