arXiv:2508.07926cs.LG2025-08

通过噪声数据增强提升扩散模型泛化能力,有效缓解小样本过拟合。

Score Augmentation for Diffusion Models

  • 在噪声数据上进行变换,让去噪器学习不同空间的梯度信息。
  • 在CIFAR-10、ImageNet等数据集上显著优于基线,收敛稳定。
  • 可与传统增强结合使用,避免数据泄露,适合小样本生成任务。

扩散模型在生成建模中取得了显著成功。然而,本研究证实了在数据受限情况下扩散模型训练存在过拟合现象。为此,我们提出专为扩散模型设计的新型数据增强框架——ScoreAug。不同于传统在干净数据上操作的增强方法,ScoreAug对噪声数据施加变换,并要求去噪器预测原始目标的增强形式。这一设计建立了等变学习目标,使去噪器能在不同去噪空间中学习梯度信息,实现所谓的“得分增强”。我们还从理论上分析了在一般变换下不同空间间得分的关系。在CIFAR-10、FFHQ、AFHQv2和ImageNet等多个基准上的实验表明,ScoreAug相比基线有显著性能提升。尤其在不同数据规模和模型容量下均能有效缓解过拟合,且收敛稳定。此外,相较于标准数据增强,ScoreAug在特定条件下可规避数据泄露问题。我们还证明其可与传统增强技术协同使用,进一步提升性能。

原文摘要 · Abstract (English)

Diffusion models have achieved remarkable success in generative modeling. However, this study confirms the existence of overfitting in diffusion model training, particularly in data-limited regimes. To address this challenge, we propose Score Augmentation (ScoreAug), a novel data augmentation framework specifically designed for diffusion models. Unlike conventional augmentation approaches that operate on clean data, ScoreAug applies transformations to noisy data, aligning with the inherent denoising mechanism of diffusion. Crucially, ScoreAug further requires the denoiser to predict the augmentation of the original target. This design establishes an equivariant learning objective, enabling the denoiser to learn scores across varied denoising spaces, thereby realizing what we term score augmentation. We also theoretically analyze the relationship between scores in different spaces under general transformations. In experiments, we extensively validate ScoreAug on multiple benchmarks including CIFAR-10, FFHQ, AFHQv2, and ImageNet, with results demonstrating significant performance improvements over baselines. Notably, ScoreAug effectively mitigates overfitting across diverse scenarios, such as varying data scales and model capacities, while exhibiting stable convergence properties. Another advantage of ScoreAug over standard data augmentation lies in its ability to circumvent data leakage issues under certain conditions. Furthermore, we show that ScoreAug can be synergistically combined with traditional data augmentation techniques to achieve additional performance gains.

扩散模型数据增强过拟合缓解生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。