提出双向正则化方法,平衡持续学习中稳定与灵活的矛盾。
Flashbacks to Harmonize Stability and Plasticity in Continual Learning
- 用双向知识库正则化更新,同时提升新旧知识保留能力。
- 在标准图像数据集上,分类准确率提升最高达4.91%。
- 适合希望提升模型长期学习能力的研究者和工程师。
我们提出闪回学习(Flashback Learning, FL),一种新型持续学习方法,旨在调和模型在持续学习中的稳定性与可塑性。不同于以往主要通过正则化模型更新来保护旧知识的方法,FL通过双向正则化机制显式平衡这一权衡。该方法采用两阶段训练流程,可无缝集成到重放、参数正则化、知识蒸馏及动态架构等多种持续学习范式中。设计中引入两个不同知识库:一个增强可塑性,另一个提升稳定性,共同调节模型更新,实现更均衡的表现。理论分析表明,FL机制能有效改善稳定性-可塑性平衡。实验显示,在相同训练预算下,相比基线方法有显著提升:在类增量设置下平均准确率提升最高达4.91%,任务增量设置下达3.51%。稳定性-可塑性比率测量也验证了该平衡的增强效果。此外,FL在更难的ImageNet数据集上亦优于当前最优持续学习方法。
原文摘要 · Abstract (English)
We introduce Flashback Learning (FL), a novel method designed to harmonize the stability and plasticity of models in Continual Learning (CL). Unlike prior approaches that primarily focus on regularizing model updates to preserve old information while learning new concepts, FL explicitly balances this trade-off through a bidirectional form of regularization. This approach effectively guides the model to swiftly incorporate new knowledge while actively retaining its old knowledge. FL operates through a two-phase training process and can be seamlessly integrated into various CL methods, including replay, parameter regularization, distillation, and dynamic architecture techniques. In designing FL, we use two distinct knowledge bases: one to enhance plasticity and another to improve stability. FL ensures a more balanced model by utilizing both knowledge bases to regularize model updates. Theoretically, we analyze how the FL mechanism enhances the stability-plasticity balance. Empirically, FL demonstrates tangible improvements over baseline methods within the same training budget. By integrating FL into at least one representative baseline from each CL category, we observed an average accuracy improvement of up to 4.91% in Class-Incremental and 3.51% in Task-Incremental settings on standard image classification benchmarks. Additionally, measurements of the stability-to-plasticity ratio confirm that FL effectively enhances this balance. FL also outperforms state-of-the-art CL methods on more challenging datasets like ImageNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。