GAN生成数据在小样本下会加剧分类偏见,扩散模型更优。
When Generative Augmentation Hurts: A Benchmark Study of GAN and Diffusion Models for Bias Correction in AI Classification Systems
- 对比传统增强、FastGAN与微调的Stable Diffusion三种方法
- FastGAN使偏见差距增加20.7%,扩散模型降低13.1%偏见
- 适合关注数据增强副作用与小样本公平性的研究者
生成模型常用于缓解人工智能训练中的类别不平衡问题,但其在低数据条件下的失效机制尚不明确。本研究在细粒度动物分类任务上,对三种增强策略进行受控基准测试:传统变换、FastGAN和使用低秩适配(LoRA)微调的Stable Diffusion 1.5。基于牛津-IIIT宠物数据集,人工设置八个少数品种数据不足。结果表明,当训练样本每类少于20至50个时,FastGAN不仅表现不佳,反而显著加剧分类器偏见(偏见差距提升20.7%,Cohen's d = +5.03,p = 0.013),且特征嵌入分析显示其生成图像形成脱离真实分布的孤立簇,符合模式崩溃特征。而微调后的稳定扩散模型表现最佳,宏观F1达0.9125±0.0047,较无增强基线偏见差距减少13.1%。所有实验均在6-8GB消费级显卡上完成,无需云端计算。
原文摘要 · Abstract (English)
Generative models are widely used to compensate for class imbalance in AI training pipelines, yet their failure modes under low-data conditions are poorly understood. This paper reports a controlled benchmark comparing three augmentation strategies applied to a fine-grained animal classification task: traditional transforms, FastGAN, and Stable Diffusion 1.5 fine-tuned with Low-Rank Adaptation (LoRA). Using the Oxford-IIIT Pet Dataset with eight artificially underrepresented breeds, we find that FastGAN augmentation does not merely underperform at very low training set sizes but actively increases classifier bias, with a statistically significant large effect across three random seeds (bias gap increase: +20.7%, Cohen's d = +5.03, p = 0.013). The effect size here is large enough to give confidence in the direction of the finding despite the small number of seeds. Feature embedding analysis using t-distributed Stochastic Neighbor Embedding reveals that FastGAN images for severe-minority breeds form tight isolated clusters outside the real image distribution, a pattern consistent with mode collapse. Stable Diffusion with Low-Rank Adaptation produced the best results overall, achieving the highest macro F1 (0.9125 plus or minus 0.0047) and a 13.1% reduction in the bias gap relative to the unaugmented baseline. The data suggest a sample-size boundary somewhere between 20 and 50 training images per class below which GAN augmentation becomes harmful in this setting, though further work across additional domains is needed to establish where that boundary sits more precisely. All experiments run on a consumer-grade GPU with 6 to 8 GB of memory, with no cloud compute required.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。