发现扩散模型生成时存在信噪比与时间步不匹配问题,提出简单修正方法提升质量。
Elucidating the SNR-t Bias of Diffusion Probabilistic Models

- 按频段分解样本,对不同频率分量分别做差分校正
- 在多个模型和数据集上显著提升生成质量,计算开销极小
- 适合关注生成细节质量的扩散模型研究者与应用开发者
扩散概率模型在多种生成任务中表现优异,但我们发现其常存在信号-噪声比-时间步(SNR-t)偏差。该偏差指推理阶段去噪样本的信噪比与其对应时间步不匹配。训练时信噪比严格关联时间步,但推理中这种对应关系被破坏,导致误差累积,降低生成质量。本文通过全面实证与理论分析证实此现象,并提出一种简单有效的差分校正方法。鉴于扩散模型通常先重建低频成分再聚焦高频细节,我们对样本进行频段分解,对各频段分别实施差分校正。大量实验表明,该方法显著提升了包括IDDPM、ADM、DDIM、A-DPM、EA-DPM、EDM、PFGM++和FLUX在内的多种扩散模型在多分辨率数据集上的生成质量,且计算开销可忽略。代码已公开于https://github.com/AMAP-ML/DCW。
原文摘要 · Abstract (English)
Diffusion Probabilistic Models have demonstrated remarkable performance across a wide range of generative tasks. However, we have observed that these models often suffer from a Signal-to-Noise Ratio-timestep (SNR-t) bias. This bias refers to the misalignment between the SNR of the denoising sample and its corresponding timestep during the inference phase. Specifically, during training, the SNR of a sample is strictly coupled with its timestep. However, this correspondence is disrupted during inference, leading to error accumulation and impairing the generation quality. We provide comprehensive empirical evidence and theoretical analysis to substantiate this phenomenon and propose a simple yet effective differential correction method to mitigate the SNR-t bias. Recognizing that diffusion models typically reconstruct low-frequency components before focusing on high-frequency details during the reverse denoising process, we decompose samples into various frequency components and apply differential correction to each component individually. Extensive experiments show that our approach significantly improves the generation quality of various diffusion models (IDDPM, ADM, DDIM, A-DPM, EA-DPM, EDM, PFGM++, and FLUX) on datasets of various resolutions with negligible computational overhead. The code is at https://github.com/AMAP-ML/DCW.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。