arXiv:2506.15720cs.LGcs.CV2025-06CVPR被引 4

提出三权重集成方法,缓解少样本增量学习中的遗忘与过拟合问题。

Tripartite Weight-Space Ensemble for Few-Shot Class-Incremental Learning

  • 在权重空间融合基础、前一阶段和当前模型,动态更新分类头。
  • 在miniImageNet等数据集上达到最新最佳性能,超越现有方法。
  • 适合需要持续学习新类别的实际应用场景,如智能推荐系统。

少样本类别增量学习(FSCIL)使模型能以少量样本持续学习新概念。在此过程中,模型经历大幅更新,易导致对旧概念的灾难性遗忘和对有限新样本的过拟合。现有主流方法通常将特征提取与分类头解耦,先在基类(大量样本、多类别)上训练并固定特征提取器,再进行增量学习。但固定特征提取器限制了模型对新类别的适应能力。为此,本文提出一种新型FSCIL方法,可无缝用少量样本更新整个模型。核心是三权重空间集成(Tri-WE),在权重空间中插值基模型、前一阶段模型和当前模型,尤其针对分类头。该方法协同保留基模型与前一阶段模型的知识。此外,考虑到从少量数据中蒸馏泛化特征的挑战,我们引入一种基于增强数据的知识蒸馏正则化损失。仅通过混入少量样本数据,即可生成更丰富的数据,有效促进从前一模型中蒸馏关键知识。最终,在miniImageNet、CUB200和CIFAR100数据集上均取得当前最优结果。

原文摘要 · Abstract (English)

Few-shot class incremental learning (FSCIL) enables the continual learning of new concepts with only a few training examples. In FSCIL, the model undergoes substantial updates, making it prone to forgetting previous concepts and overfitting to the limited new examples. Most recent trend is typically to disentangle the learning of the representation from the classification head of the model. A well-generalized feature extractor on the base classes (many examples and many classes) is learned, and then fixed during incremental learning. Arguing that the fixed feature extractor restricts the model's adaptability to new classes, we introduce a novel FSCIL method to effectively address catastrophic forgetting and overfitting issues. Our method enables to seamlessly update the entire model with a few examples. We mainly propose a tripartite weight-space ensemble (Tri-WE). Tri-WE interpolates the base, immediately previous, and current models in weight-space, especially for the classification heads of the models. Then, it collaboratively maintains knowledge from the base and previous models. In addition, we recognize the challenges of distilling generalized representations from the previous model from scarce data. Hence, we suggest a regularization loss term using amplified data knowledge distillation. Simply intermixing the few-shot data, we can produce richer data enabling the distillation of critical knowledge from the previous model. Consequently, we attain state-of-the-art results on the miniImageNet, CUB200, and CIFAR100 datasets.

增量学习少样本知识蒸馏模型更新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。