arXiv:2601.07117cs.CVcs.AI2026-01IJCV

用生成记忆正则化,让模型少样本增量学习时既记旧知识又不被新数据带偏。

Few-shot Class-Incremental Learning via Generative Co-Memory Regularization

  • 用生成式域适应微调预训练编码器,同时重建特征和分类。
  • 构建类级表征与权重记忆,动态更新以缓解遗忘和过拟合。
  • 适合少样本增量学习场景,尤其在旧类记忆保持上表现优异。

少样本增量学习(FSCIL)旨在从少量新数据中逐步学习模型,要求模型在少样本监督下具备强表征与适应能力,以避免对旧类的灾难性遗忘和对新类的过拟合。本文提出一种生成式协同记忆正则化方法:首先利用生成式域适应微调,在少量基类样本上对预训练生成编码器进行微调,联合使用掩码自编码器(MAE)解码器进行特征重建和全连接分类器进行特征分类,从而高效捕捉通用且可迁移的表征。随后,基于微调后的编码器和分类器,构建两类类级记忆:存储每类均值特征的表征记忆,以及存储分类器权重的权重记忆。在每个增量会话中,通过联合优化特征分类与协同记忆正则化,动态训练分类器以处理少样本新类数据。记忆以类增量方式更新,协同约束增量学习过程。实验表明,该方法在多个主流基准上显著优于现有方法,有效提升识别准确率,同时缓解旧类遗忘与新类过拟合问题。

原文摘要 · Abstract (English)

Few-shot class-incremental learning (FSCIL) aims to incrementally learn models from a small amount of novel data, which requires strong representation and adaptation ability of models learned under few-example supervision to avoid catastrophic forgetting on old classes and overfitting to novel classes. This work proposes a generative co-memory regularization approach to facilitate FSCIL. In the approach, the base learning leverages generative domain adaptation finetuning to finetune a pretrained generative encoder on a few examples of base classes by jointly incorporating a masked autoencoder (MAE) decoder for feature reconstruction and a fully-connected classifier for feature classification, which enables the model to efficiently capture general and adaptable representations. Using the finetuned encoder and learned classifier, we construct two class-wise memories: representation memory for storing the mean features for each class, and weight memory for storing the classifier weights. After that, the memory-regularized incremental learning is performed to train the classifier dynamically on the examples of few-shot classes in each incremental session by simultaneously optimizing feature classification and co-memory regularization. The memories are updated in a class-incremental manner and they collaboratively regularize the incremental learning. In this way, the learned models improve recognition accuracy, while mitigating catastrophic forgetting over old classes and overfitting to novel classes. Extensive experiments on popular benchmarks clearly demonstrate that our approach outperforms the state-of-the-arts.

少样本学习增量学习生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。