arXiv:2603.02280cs.LGcs.AI2026-03中稿 · CVPR

提出时间不平衡机制,缓解增量学习中旧类遗忘问题

Temporal Imbalance of Positive and Negative Supervision in Class-Incremental Learning

  • 引入时间衰减核动态调整负样本监督强度
  • 在多个基准上显著降低遗忘率,提升旧类识别准确率
  • 适合关注长期稳定学习的增量学习研究者

随着深度学习在视觉任务中的广泛应用,类别增量学习(CIL)已成为处理数据分布动态变化的重要范式。然而,CIL面临灾难性遗忘的核心挑战,常表现为对新类别的预测偏差。现有方法主要归因于类内不平衡,并聚焦于分类头的修正。本文指出被忽视的关键因素——时间不平衡:早期类别在训练末期受到更强的负向监督,导致精确率与召回率不对称。我们建立时间监督模型,形式化定义时间不平衡,并提出时序调整损失(TAL),通过时间衰减核构建监督强度向量,动态重加权交叉熵损失中的负向监督。理论分析表明,当条件平衡时TAL退化为标准交叉熵,在不平衡下能有效缓解预测偏差。大量实验显示,TAL显著减少遗忘,在多个CIL基准上提升性能,凸显时间建模对长期稳定学习的重要性。

原文摘要 · Abstract (English)

With the widespread adoption of deep learning in visual tasks, Class-Incremental Learning (CIL) has become an important paradigm for handling dynamically evolving data distributions. However, CIL faces the core challenge of catastrophic forgetting, often manifested as a prediction bias toward new classes. Existing methods mainly attribute this bias to intra-task class imbalance and focus on corrections at the classifier head. In this paper, we highlight an overlooked factor -- temporal imbalance -- as a key cause of this bias. Earlier classes receive stronger negative supervision toward the end of training, leading to asymmetric precision and recall. We establish a temporal supervision model, formally define temporal imbalance, and propose Temporal-Adjusted Loss (TAL), which uses a temporal decay kernel to construct a supervision strength vector and dynamically reweight the negative supervision in cross-entropy loss. Theoretical analysis shows that TAL degenerates to standard cross-entropy under balanced conditions and effectively mitigates prediction bias under imbalance. Extensive experiments demonstrate that TAL significantly reduces forgetting and improves performance on multiple CIL benchmarks, underscoring the importance of temporal modeling for stable long-term learning.

增量学习灾难性遗忘监督机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。