arXiv:2411.19154cs.LGcs.AI2024-11被引 6

提出无需重放的持续学习方法,有效防止遗忘并提升新旧知识融合

DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning

  • 基于LoRA的轻量级模块,训练时不加约束以最大化新知识学习
  • 动态表征整合与分类边界优化,显著提升模型在多个数据集上的表现
  • 适合追求高效、无重放持续学习的开发者和研究者

持续学习旨在使模型具备类似人类的旧知识保留能力。近期采用参数高效微调的方法通过引入轻量级扩展模块重振该领域。然而,现有方法常忽视预训练模型中使用过实验数据所导致的信息泄露问题:一旦这些重复数据在预训练阶段被移除,模型性能会严重下降。本文提出一种基于LoRA的无重放持续学习方法DESIRE。该方法在训练中不施加额外约束,以最大限度学习新类别。为融合旧任务与新任务的知识,我们设计两个高效后处理模块:一方面,仅保留两组LoRA参数进行合并,并提出动态表征整合来校准合并后的特征表示;另一方面,提出决策边界精修以缓解仅在新类别数据上训练带来的分类器偏差。大量实验表明,本方法在多个数据集上达到当前最优性能,有效平衡了稳定性与可塑性。代码将公开。

原文摘要 · Abstract (English)

Continual learning aims to equip models with the ability to retain previously learned knowledge like a human. Recent work incorporating Parameter-Efficient Fine-Tuning has revitalized the field by introducing lightweight extension modules. However, existing methods usually overlook the issue of information leakage caused by the fact that the experiment data have been used in pre-trained models. Once these duplicate data are removed in the pre-training phase, their performance can be severely affected. In this paper, we propose a new LoRA-based rehearsal-free method named DESIRE. Our method avoids imposing additional constraints during training to mitigate catastrophic forgetting, thereby maximizing the learning of new classes. To integrate knowledge from old and new tasks, we propose two efficient post-processing modules. On the one hand, we retain only two sets of LoRA parameters for merging and propose dynamic representation consolidation to calibrate the merged feature representation. On the other hand, we propose decision boundary refinement to address classifier bias when training solely on new class data. Extensive experiments demonstrate that our method achieves state-of-the-art performance on multiple datasets and strikes an effective balance between stability and plasticity. Our code will be publicly available.

持续学习LoRA参数效率知识保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。