arXiv:2501.13198cs.LG2025-01ICLR被引 75

提出可扩展的分离式低秩适配方法,实现无回放的持续学习。

SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learning

  • 将LoRA的幅度与方向解耦,持续分离训练避免参数膨胀。
  • 在多个基准上优于现有方法,保持稳定与灵活的平衡。
  • 适合资源受限场景下的持续学习应用,如边缘设备部署。

基于基础模型的持续学习(CL)正成为利用预训练知识应对序列任务的有前景范式。然而,现有基于提示和低秩适配(LoRA)的方法通常需要扩展提示/LoRA池或保留旧任务样本,随着任务数量增加面临显著可扩展性挑战。为此,我们提出可扩展的解耦式低秩适配(SD-LoRA),用于类别增量学习,通过无需回放地持续分离LoRA组件的幅度与方向来解决该问题。实证与理论分析表明,SD-LoRA倾向于沿低损失轨迹演化,并收敛至所有已学任务共享的低损失区域,从而实现优异的稳定性-灵活性权衡。基于此,我们进一步提出两种参数效率更高的变体,所有参数均可端到端优化以适应CL目标。同时,它们支持高效推理,可直接使用最终训练好的模型进行评估,无需组件选择。在多个CL基准和基础模型上的大量实验一致验证了SD-LoRA的有效性。

原文摘要 · Abstract (English)

Continual Learning (CL) with foundation models has recently emerged as a promising paradigm to exploit abundant knowledge acquired during pre-training for tackling sequential tasks. However, existing prompt-based and Low-Rank Adaptation-based (LoRA-based) methods often require expanding a prompt/LoRA pool or retaining samples of previous tasks, which poses significant scalability challenges as the number of tasks grows. To address these limitations, we propose Scalable Decoupled LoRA (SD-LoRA) for class incremental learning, which continually separates the learning of the magnitude and direction of LoRA components without rehearsal. Our empirical and theoretical analysis reveals that SD-LoRA tends to follow a low-loss trajectory and converges to an overlapping low-loss region for all learned tasks, resulting in an excellent stability-plasticity trade-off. Building upon these insights, we introduce two variants of SD-LoRA with further improved parameter efficiency. All parameters of SD-LoRAs can be end-to-end optimized for CL objectives. Meanwhile, they support efficient inference by allowing direct evaluation with the finally trained model, obviating the need for component selection. Extensive experiments across multiple CL benchmarks and foundation models consistently validate the effectiveness of SD-LoRA. The code is available at https://github.com/WuYichen-97/SD-Lora-CL.

持续学习低秩适配解耦学习模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。