arXiv:2411.15235cs.LGcs.AI2024-11ICCV被引 6

用概念矩阵动态平衡记忆与学习,缓解持续学习中的遗忘与知识迁移障碍。

CODE-CL: Conceptor-Based Gradient Projection for Deep Continual Learning

  • 基于概念矩阵的梯度投影,自适应处理高度相关的任务。
  • 在多个基准上实现更低遗忘率和更强前向知识迁移能力。
  • 适合需要长期学习新知识且任务间有重叠的场景。

持续学习(CL)使智能系统能够逐步获取并整合新知识,以适应动态环境。然而,深度神经网络在顺序学习任务时面临灾难性遗忘(CF),因为新任务的训练常会覆盖已学知识。现有方法通过梯度投影至正交子空间来约束更新,有效保留旧任务的重要梯度方向。但这类方法在任务高度相关时,反而抑制了前向知识迁移(FWT)。本文提出一种基于概念矩阵的深度持续学习方法(CODE-CL),利用正则化重构的概念矩阵表示,自适应处理高度相关的任务。CODE-CL通过将梯度投影到先前任务特征空间的伪正交子空间,同时促进向前的知识迁移,其核心是学习共享基方向的线性组合,从而高效平衡稳定性与可塑性,并实现重叠输入特征表示间的知识传递。在多个持续学习基准上的实验验证了其有效性,相比当前最优方法,显著降低了遗忘率并提升了前向知识迁移能力。

原文摘要 · Abstract (English)

Continual learning (CL) - the ability to progressively acquire and integrate new concepts - is essential to intelligent systems to adapt to dynamic environments. However, deep neural networks struggle with catastrophic forgetting (CF) when learning tasks sequentially, as training for new tasks often overwrites previously learned knowledge. To address this, recent approaches constrain updates to orthogonal subspaces using gradient projection, effectively preserving important gradient directions for previous tasks. While effective in reducing forgetting, these approaches inadvertently hinder forward knowledge transfer (FWT), particularly when tasks are highly correlated. In this work, we propose Conceptor-based gradient projection for Deep Continual Learning (CODE-CL), a novel method that leverages conceptor matrix representations, a form of regularized reconstruction, to adaptively handle highly correlated tasks. CODE-CL mitigates CF by projecting gradients onto pseudo-orthogonal subspaces of previous task feature spaces while simultaneously promoting FWT. It achieves this by learning a linear combination of shared basis directions, allowing efficient balance between stability and plasticity and transfer of knowledge between overlapping input feature representations. Extensive experiments on continual learning benchmarks validate CODE-CL's efficacy, demonstrating superior performance, reduced forgetting, and improved FWT as compared to state-of-the-art methods.

持续学习梯度投影概念矩阵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。