arXiv:2607.22994cs.CVcs.LG2026-07中稿 · ICML

解决生成式增量学习中真假数据混合导致的性能下降问题

Breaking the Synthetic-Real Domain Shortcut for Training-Free Generative Replay-based Class Incremental Learning

论文配图:Breaking the Synthetic-Real Domain Shortcut for Training-Free Generative Replay-based Class Incremental Learning
图 1 · 摘自论文原文
  • 用无训练生成器合成旧类数据,避免存储隐私问题
  • 通过子空间修正和正交投影消除领域特征依赖,提升分类准确率
  • 适合关注隐私保护与高效增量学习的研究者

类别增量学习(CIL)要求模型在不遗忘旧知识的前提下持续学习新类别。尽管回放样例有效,但存在隐私和存储问题。生成式回放利用冻结的预训练文本到图像(T2I)模型生成旧类数据,无需额外训练。然而,直接将合成旧类数据与真实新类数据混合训练会导致显著性能下降。问题源于“领域捷径”:模型依赖领域判别特征而非语义类别线索。为此,我们提出DREAM(领域正则化无样例对齐模型),通过训练自由生成器合成旧类数据,利用子空间修正和正交投影消除领域捷径,并通过真实锚定原型正则化强化语义对齐。在4个数据集上的实验表明,DREAM优于现有无样例方法,达到当前最佳性能。

原文摘要 · Abstract (English)

Class-incremental learning (CIL) requires models to continuously acquire new knowledge while avoiding catastrophic forgetting. While exemplar replay is effective, it raises concerns regarding privacy and storage. Thus, generative replay has emerged as a viable alternative, synthesizing old data using frozen pretrained text-to-image (T2I) models without any extra training. However, we observe that directly mixing synthetic old-class data with real new-class data during incremental training leads to significant performance degradation. This issue stems from a "domain shortcut", where models rely on domain-discriminative features instead of semantic class cues. To address this, we propose DREAM ($\underline{\mathbf{D}}$omain-$\underline{\mathbf{R}}$egularized $\underline{\mathbf{E}}$xemplar-free $\underline{\mathbf{A}}$lignment $\underline{\mathbf{M}}$odel), which uses a training-free generator to synthesize old-class data and eliminates domain shortcut via subspace rectification and orthogonal projection, while reinforcing semantic alignment through real-anchored prototype regularization. Extensive experiments on 4 datasets demonstrate that DREAM outperforms existing exemplar-free CIL methods and achieves state-of-the-art performance. Our source code is available at https://github.com/Light-ZhangTao/DREAM.

增量学习生成模型隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。