arXiv:2503.04638cs.LG2025-03被引 1

不存记忆样本也能持续学习,靠的是模型本身的冗余能力。

No Forgetting Learning: Buffer-free Continual Learning Classification

  • 用共享主干+任务专用头,分步冻结来隔离新旧知识。
  • 在50个任务上比其他无缓存方法强,仅需基线2.53%模型大小。
  • 适合资源受限或隐私敏感场景,如医疗影像持续学习。

多数持续学习方法依赖回放缓冲区存储样例以保持旧任务性能,带来随任务数增长的内存开销和隐私风险。本文提出无遗忘学习(NFL),一种无需缓冲区的类别与任务增量学习框架,利用过参数化网络的内在冗余性。NFL将网络分解为共享主干与任务特定头,采用分步冻结策略:先隔离新能力,再通过知识蒸馏适应共享表示,并结合双重软目标锚定联合优化。NFL+在此基础上引入欠完备自编码器,保留先前任务信息并纠正类别不平衡导致的预测偏差。NFL+LoRA进一步扩展至预训练ViT,通过费舍尔加权正则化的低秩子空间更新,确保主干内存成本恒定。在CIFAR-100、Tiny-ImageNet和ImageNet-1000上,最多50个增量任务下,NFL+超越所有无缓存基线,媲美带记忆方法,仅需其2.53%模型规模。同时提出塑性-稳定性评分,用于更均衡的权衡评估。

原文摘要 · Abstract (English)

Most Continual Learning (CL) methods maintain performance on earlier tasks by storing exemplars in a replay buffer, introducing memory overhead that scales with the number of tasks and raising privacy concerns in regulated domains. We propose No Forgetting Learning (NFL), a buffer-free framework for class- and task-incremental learning that instead exploits the inherent redundancy of overparameterized networks. NFL decomposes the network into a shared backbone and task-specific heads, then applies a stepwise freezing protocol: new capabilities are first isolated, shared representations are adapted under knowledge distillation, and all components are jointly refined with dual soft-target anchoring. NFL+ augments this pipeline with an under-complete auto-encoder that preserves informative features from previous tasks and corrects the prediction bias caused by class imbalance. NFL+LoRA further extends the framework to pre-trained Vision Transformers by confining updates to a low-rank subspace with Fisher-weighted regularization, maintaining constant backbone memory cost regardless of the number of tasks. On CIFAR-100, Tiny-ImageNet, and ImageNet-1000 across up to 50 incremental tasks, NFL+ outperforms all buffer-free baselines and matches memory-based methods while requiring only 2.53\% of their model size. We also propose a Plasticity--Stability score for more balanced trade-off evaluation.

持续学习无缓存模型压缩ViT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。