提出混合模糊与噪声的扩散模型,提升生成图像质量与稳定性。
Warm Diffusion: Recipe for Blur-Noise Mixture Diffusion Models
- 将模糊与噪声联合建模,分离去噪与去模糊过程以简化训练。
- 在多个基准上实现优于纯噪声或纯模糊模型的生成效果。
- 适合关注图像细节生成与数据流形保持的研究者。
扩散概率模型在多种数据类型的生成任务中取得了显著成功。尽管近期研究探索了超越高斯噪声的其他退化过程,本文却连接了两种关键的扩散范式:完全依赖噪声的热扩散与仅使用模糊的冷扩散。我们指出,热扩散未能利用高频图像细节与低频结构之间的强相关性,导致生成初期行为随机;而冷扩散虽利用图像相关性进行预测,却忽略了噪声(随机性)对数据流形的塑造作用,引发流形外问题并部分解释其性能下降。为融合两者优势,我们提出统一的模糊-噪声混合扩散模型(BNMD),通过分治策略利用图像的频谱依赖性,解耦去噪与去模糊过程以简化得分模型估计。进一步通过频谱分析研究模糊-噪声比(BNR),揭示模型学习动态与数据流形变化间的权衡。大量实验验证了该方法在图像生成任务中的有效性。
原文摘要 · Abstract (English)
Diffusion probabilistic models have achieved remarkable success in generative tasks across diverse data types. While recent studies have explored alternative degradation processes beyond Gaussian noise, this paper bridges two key diffusion paradigms: hot diffusion, which relies entirely on noise, and cold diffusion, which uses only blurring without noise. We argue that hot diffusion fails to exploit the strong correlation between high-frequency image detail and low-frequency structures, leading to random behaviors in the early steps of generation. Conversely, while cold diffusion leverages image correlations for prediction, it neglects the role of noise (randomness) in shaping the data manifold, resulting in out-of-manifold issues and partially explaining its performance drop. To integrate both strengths, we propose Warm Diffusion, a unified Blur-Noise Mixture Diffusion Model (BNMD), to control blurring and noise jointly. Our divide-and-conquer strategy exploits the spectral dependency in images, simplifying score model estimation by disentangling the denoising and deblurring processes. We further analyze the Blur-to-Noise Ratio (BNR) using spectral analysis to investigate the trade-off between model learning dynamics and changes in the data manifold. Extensive experiments across benchmarks validate the effectiveness of our approach for image generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。