arXiv:2510.03608cs.CV2025-10NeurIPS

通过扩散模型与分类器互促循环,提升小样本增量学习的泛化能力。

Diffusion-Classifier Synergy: Reward-Aligned Learning via Mutual Boosting Loop for FSCIL

  • 构建扩散模型与分类器的双向增强机制,实现协同进化。
  • 在多个基准上达到最优性能,有效缓解遗忘并提升新类识别能力。
  • 适合关注小样本持续学习与生成式数据增强的研究者。

少样本增量学习(FSCIL)要求模型在极少样本下逐步学习新类别,同时避免遗忘旧知识,面临稳定性与可塑性矛盾及数据稀缺挑战。现有方法因依赖有限数据,泛化能力受限。尽管扩散模型可用于数据增强,但直接应用易引发语义错位或无效引导。本文提出扩散-分类器协同框架(DCS),建立扩散模型与FSCIL分类器间的相互增强循环。DCS采用奖励对齐学习策略,利用分类器状态动态生成多维度奖励函数,从特征层面通过原型锚定的最大均值差异和维度方差匹配保障语义一致性与多样性;从逻辑层面通过置信度重校准与跨会话混淆感知机制促进探索性图像生成并增强类间可区分性。该共演化过程使生成图像优化分类器,而改进的分类器状态又提供更优奖励信号,在多个FSCIL基准上显著优于现有方法,大幅提高知识保留与新类学习能力。

原文摘要 · Abstract (English)

Few-Shot Class-Incremental Learning (FSCIL) challenges models to sequentially learn new classes from minimal examples without forgetting prior knowledge, a task complicated by the stability-plasticity dilemma and data scarcity. Current FSCIL methods often struggle with generalization due to their reliance on limited datasets. While diffusion models offer a path for data augmentation, their direct application can lead to semantic misalignment or ineffective guidance. This paper introduces Diffusion-Classifier Synergy (DCS), a novel framework that establishes a mutual boosting loop between diffusion model and FSCIL classifier. DCS utilizes a reward-aligned learning strategy, where a dynamic, multi-faceted reward function derived from the classifier's state directs the diffusion model. This reward system operates at two levels: the feature level ensures semantic coherence and diversity using prototype-anchored maximum mean discrepancy and dimension-wise variance matching, while the logits level promotes exploratory image generation and enhances inter-class discriminability through confidence recalibration and cross-session confusion-aware mechanisms. This co-evolutionary process, where generated images refine the classifier and an improved classifier state yields better reward signals, demonstrably achieves state-of-the-art performance on FSCIL benchmarks, significantly enhancing both knowledge retention and new class learning.

少样本学习增量学习扩散模型生成增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。