通过梯度空间拆分,让模型在学新任务时既不忘记旧知识,又能高效学习。
SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splitting
- 基于低秩适配,将梯度空间拆分为主次子空间以隔离任务干扰
- 理论分析指导最优划分,在多个数据集上达到当前最佳性能
- 适合需要长期学习新任务且不遗忘旧知识的场景
持续学习要求模型按顺序学习多个任务,同时保持稳定性(保留旧知识)与可塑性(有效学习新任务)。梯度投影已成为主流方法,通过将已有任务的梯度空间划分为正交的主子空间与次子空间,使新任务在次子空间中学习,减少对旧知识的干扰。然而,现有方法难以实现稳定与可塑性的最佳平衡,因梯度空间划分不当。本文提出基于低秩适配(LoRA)的SplitLoRA方法,首次提供子空间划分对稳定性与可塑性影响的理论分析,并据此设计有效算法,自动推导先前任务梯度空间的最优划分。实验表明,该方法在多个数据集上均取得领先性能。
原文摘要 · Abstract (English)
Continual Learning requires a model to learn multiple tasks in sequence while maintaining both stability:preserving knowledge from previously learned tasks, and plasticity:effectively learning new tasks. Gradient projection has emerged as an effective and popular paradigm in CL, where it partitions the gradient space of previously learned tasks into two orthogonal subspaces: a primary subspace and a minor subspace. New tasks are learned effectively within the minor subspace, thereby reducing interference with previously acquired knowledge. However, existing Gradient Projection methods struggle to achieve an optimal balance between plasticity and stability, as it is hard to appropriately partition the gradient space. In this work, we consider a continual learning paradigm based on Low-Rank Adaptation, which has gained considerable attention due to its efficiency and wide applicability, and propose a novel approach for continual learning, called SplitLoRA. We first provide a theoretical analysis of how subspace partitioning affects model stability and plasticity. Informed by this analysis, we then introduce an effective method that derives the optimal partition of the gradient space for previously learned tasks. This approach effectively balances stability and plasticity in continual learning. Experimental results on multiple datasets demonstrate that the proposed method achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。