arXiv:2505.11278stat.MLcs.CV2025-05被引 51

提出傅里叶空间新扩散过程,提升高频细节生成质量。

A Fourier Space Perspective on Diffusion Models

  • 在傅里叶空间设计均匀退化过程,打破高低频污染差异
  • 实验显示高频成分生成质量显著提升,尤其在高频率主导数据集上
  • 适合关注图像/音频高频细节生成的研究者

扩散模型是图像、音频、蛋白质和材料等数据模态的前沿生成模型。这些模态在傅里叶域中具有指数衰减的方差与幅度特性。标准加性白噪声前向过程下,高频分量比低频分量更早且更快被噪声破坏,导致信噪比(SNR)下降更快。反向生成过程因此先生成低频信息,再生成高频细节。本文从傅里叶空间分析扩散模型前向过程的归纳偏置,理论与实证表明,DDPM中高频分量过快退化违反了反向过程的正态性假设,导致高频生成质量下降。我们提出一种傅里叶空间中的替代前向过程,使所有频率以相同速率退化,消除生成时的频率层级。该方法在高频为主的数据集上表现显著优于DDPM,而在标准图像基准上保持相当性能。

原文摘要 · Abstract (English)

Diffusion models are state-of-the-art generative models on data modalities such as images, audio, proteins and materials. These modalities share the property of exponentially decaying variance and magnitude in the Fourier domain. Under the standard Denoising Diffusion Probabilistic Models (DDPM) forward process of additive white noise, this property results in high-frequency components being corrupted faster and earlier in terms of their Signal-to-Noise Ratio (SNR) than low-frequency ones. The reverse process then generates low-frequency information before high-frequency details. In this work, we study the inductive bias of the forward process of diffusion models in Fourier space. We theoretically analyse and empirically demonstrate that the faster noising of high-frequency components in DDPM results in violations of the normality assumption in the reverse process. Our experiments show that this leads to degraded generation quality of high-frequency components. We then study an alternate forward process in Fourier space which corrupts all frequencies at the same rate, removing the typical frequency hierarchy during generation, and demonstrate marked performance improvements on datasets where high frequencies are primary, while performing on par with DDPM on standard imaging benchmarks.

扩散模型傅里叶空间生成质量高频细节

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。