提出CL-LoRA,用共享与特定适配器实现无回放类增量学习。
CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning
- 设计共享与特定双适配器结构,融合跨任务知识和新任务特性。
- 在多个基准上表现优异,训练与推理计算量显著降低。
- 适合资源受限场景下的持续学习应用,尤其适用于预训练模型微调。
类增量学习(CIL)旨在顺序学习新类别,同时保留旧类知识。近期,结合预训练模型(PTMs)与参数高效微调(PEFT)的方法在无需旧类样本的情况下实现了出色性能。然而,现有基于适配器的方法为每个新任务创建独立适配器,导致参数冗余且难以共享跨任务知识。本文提出连续低秩适配(CL-LoRA),采用新型双适配器架构:任务共享适配器用于学习跨任务共性,任务特定适配器捕捉每项任务的独特特征。共享适配器利用随机正交矩阵,并通过梯度重分配的知识蒸馏策略保留关键共享知识;任务特定适配器引入可学习的块级权重,缓解任务间干扰,同时保持模型可塑性。实验表明,CL-LoRA在多个基准上持续表现良好,显著降低训练与推理计算开销,为预训练模型的持续学习提供更高效、可扩展的新范式。
原文摘要 · Abstract (English)
Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown remarkable performance in rehearsal-free CIL without requiring exemplars from previous tasks. However, existing adapter-based methods, which incorporate lightweight learnable modules into PTMs for CIL, create new adapters for each new task, leading to both parameter redundancy and failure to leverage shared knowledge across tasks. In this work, we propose ContinuaL Low-Rank Adaptation (CL-LoRA), which introduces a novel dual-adapter architecture combining \textbf{task-shared adapters} to learn cross-task knowledge and \textbf{task-specific adapters} to capture unique features of each new task. Specifically, the shared adapters utilize random orthogonal matrices and leverage knowledge distillation with gradient reassignment to preserve essential shared knowledge. In addition, we introduce learnable block-wise weights for task-specific adapters, which mitigate inter-task interference while maintaining the model's plasticity. We demonstrate CL-LoRA consistently achieves promising performance under multiple benchmarks with reduced training and inference computation, establishing a more efficient and scalable paradigm for continual learning with pre-trained models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。