arXiv:2411.01465cs.CV2024-11

用生成的回溯特征替代旧类原型,缓解持续学习中的遗忘问题。

Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis

  • 用多变量高斯分布建模旧类特征空间,采样生成新特征
  • 在CIFAR-100等数据集上达到当前最优性能
  • 适合需要高效无样本增量学习的应用场景

尽管深度神经网络在单个任务中表现优异,但在真实场景中面对连续数据流时仍面临灾难性遗忘问题。现有无样本增量学习(NECIL)方法通过存储每类一个原型来缓解遗忘,但这些原型或其增强版本难以同时捕捉旧类的空间分布多样性与精确性。且随着模型学习新知识,原型逐渐过时,效果下降。为此,本文提出一种更高效的NECIL方法,用合成的回溯特征替代原型。具体地,使用多变量高斯分布建模每类特征空间,并从高似然区域采样生成深度表示。此外,引入基于相似性的特征补偿机制,将生成的旧类特征与相似的新类特征融合,合成鲁棒的回溯表示。这些回溯特征被融入增量学习框架,以保留旧类决策边界的同时学习新类。在CIFAR-100、TinyImageNet和ImageNet-Subset上的大量实验表明,该方法显著提升了无样本增量学习的效率并达到了当前最优性能。

原文摘要 · Abstract (English)

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning (NECIL) methods mitigate forgetting by storing a single prototype per class, which serves to inject previous information when sequentially learning new classes. However, these stored prototypes or their augmented variants often fail to simultaneously capture spatial distribution diversity and precision needed for representing old classes. Moreover, as the model acquires new knowledge, these prototypes gradually become outdated, making them less effective. To overcome these limitations, we propose a more efficient NECIL method that replaces prototypes with synthesized retrospective features for old classes. Specifically, we model each old class's feature space using a multivariate Gaussian distribution and generate deep representations by sampling from high-likelihood regions. Additionally, we introduce a similarity-based feature compensation mechanism that integrates generated old class features with similar new class features to synthesize robust retrospective representations. These retrospective features are then incorporated into our incremental learning framework to preserve the decision boundaries of previous classes while learning new ones. Extensive experiments on CIFAR-100, TinyImageNet, and ImageNet-Subset demonstrate that our method significantly improves the efficiency of non-exemplar class-incremental learning and achieves state-of-the-art performance.

增量学习特征合成无样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。