arXiv:2512.01818cs.LGcs.CV2025-12

提出轻量正则化方法,显著减少持续学习中的遗忘问题。

Forget Less, Retain More: A Lightweight Regularizer for Rehearsal-Based Continual Learning

  • 基于标签分布期望设计类无关正则项,可通用集成于多种重放方法。
  • 在多个数据集上均有效降低遗忘率,且计算开销极低。
  • 适用于视频等复杂数据,对域间差异具有强鲁棒性。

深度神经网络在持续学习中面临灾难性遗忘问题,即在学习新任务时会退化先前任务的性能。该问题源于模型倾向于用新信息覆盖已有知识。本文提出一种新型正则化策略——信息最大化(IM)正则器,仅依赖于预期标签分布,具备类无关特性,可直接嵌入各类基于记忆的持续学习方法中,有效缓解遗忘并促进更快收敛。实验表明,无论任务数量如何,在多个数据集上该方法均能稳定提升基线性能,且计算开销微小。由于其轻量化设计,IM正则器在实际场景中具备良好的可扩展性。此外,我们通过在具有时序结构和更高内存需求的视频数据上验证,证明其数据无关性:即使存在显著领域差异,仍能提升视频持续学习方法的表现。

原文摘要 · Abstract (English)

Deep neural networks suffer from catastrophic forgetting, where performance on previous tasks degrades after training on a new task. This issue arises due to the model's tendency to overwrite previously acquired knowledge with new information. We present a novel approach to address this challenge, focusing on the intersection of memory-based methods and regularization approaches. We formulate a regularization strategy, termed Information Maximization (IM) regularizer, for memory-based continual learning methods, which is based exclusively on the expected label distribution, thus making it class-agnostic. As a consequence, IM regularizer can be directly integrated into various rehearsal-based continual learning methods, reducing forgetting and favoring faster convergence. Our empirical validation shows that, across datasets and regardless of the number of tasks, our proposed regularization strategy consistently improves baseline performance at the expense of a minimal computational overhead. The lightweight nature of IM ensures that it remains a practical and scalable solution, making it applicable to real-world continual learning scenarios where efficiency is paramount. Finally, we demonstrate the data-agnostic nature of our regularizer by applying it to video data, which presents additional challenges due to its temporal structure and higher memory requirements. Despite the significant domain gap, our experiments show that IM regularizer also improves the performance of video continual learning methods.

持续学习正则化轻量级视频理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。