arXiv:2509.21898cs.LGcs.CV2025-09

提出IVT方法,通过参数迁移减少类别增量学习中的遗忘问题。

Closing the Oracle Gap: Increment Vector Transformation for Class Incremental Learning

  • 基于线性路径连通性,定期将模型参数转移到保持历史任务最优的解上。
  • 在CIFAR-100上使PASS基线最后准确率提升5.12%,遗忘降低2.54%。
  • 无需额外存储样本,兼容多种初始化策略,适合实际部署场景。

类别增量学习(CIL)旨在不遗忘旧知识的前提下,逐步学习新类别。尽管近期取得进展,现有方法仍与可访问全部历史数据的“理想”模型存在显著性能差距。受线性模式连通性(LMC)启发,我们发现理想解通常与先前任务最优解之间存在低损失线性连接。据此提出增量向量变换(IVT),一种即插即用框架:不直接跟随常规更新,而是周期性地将模型参数“传送”至保持与前序任务最优解线性连通性的变换解。通过维持这些路径上的低损失,确保旧任务性能稳定。变换通过对角化费舍尔信息矩阵高效近似,适用于无示例和有示例场景,且兼容多种初始化策略。在CIFAR-100、FGVCAircraft、ImageNet-Subset和ImageNet-Full上的大量实验表明,IVT持续提升强基线表现。在CIFAR-100上,使PASS基线最后准确率提升+5.12%,遗忘减少2.54%;在FGVCAircraft上,对预训练CLIP的SLCA基线,平均准确率提升+14.93%,最后准确率提升+21.95%。代码将公开。

原文摘要 · Abstract (English)

Class Incremental Learning (CIL) aims to sequentially acquire knowledge of new classes without forgetting previously learned ones. Despite recent progress, current CIL methods still exhibit significant performance gaps compared to their oracle counterparts-models trained with full access to historical data. Inspired by recent insights on Linear Mode Connectivity (LMC), we revisit the geometric properties of oracle solutions in CIL and uncover a fundamental observation: these oracle solutions typically maintain low-loss linear connections to the optimum of previous tasks. Motivated by this finding, we propose Increment Vector Transformation (IVT), a novel plug-and-play framework designed to mitigate catastrophic forgetting during training. Rather than directly following CIL updates, IVT periodically teleports the model parameters to transformed solutions that preserve linear connectivity to previous task optimum. By maintaining low-loss along these connecting paths, IVT effectively ensures stable performance on previously learned tasks. The transformation is efficiently approximated using diagonal Fisher Information Matrices, making IVT suitable for both exemplar-free and exemplar-based scenarios, and compatible with various initialization strategies. Extensive experiments on CIFAR-100, FGVCAircraft, ImageNet-Subset, and ImageNet-Full demonstrate that IVT consistently enhances the performance of strong CIL baselines. Specifically, on CIFAR-100, IVT improves the last accuracy of the PASS baseline by +5.12% and reduces forgetting by 2.54%. For the CLIP-pre-trained SLCA baseline on FGVCAircraft, IVT yields gains of +14.93% in average accuracy and +21.95% in last accuracy. The code will be released.

增量学习遗忘抑制模型优化线性连通

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。