arXiv:2605.30332cs.CV2026-05被引 1

通过频段动态注噪,让扩散模型生成更清晰图像。

Colored Noise Diffusion Sampling

论文配图:Colored Noise Diffusion Sampling
图 1 · 摘自论文原文
  • 根据频率动态调整噪声注入,更高效分配能量
  • 在ImageNet-256上FID降低1.99至3.57,效果显著
  • 无需训练,可直接替换现有采样器,适用多模型

扩散模型在图像生成中表现卓越,其生成过程具有固有的谱偏置:早期解析低频全局结构,后期处理高频细节。传统随机微分方程(SDE)求解器未考虑此动态特性,盲目在整个过程中注入均匀白噪声,浪费有限能量。本文建立数学框架,将SDE推断重新理解为定向、频段解耦的能量传递过程。基于此,提出无需训练的彩色噪声采样(CNS)新方法。CNS不使用均匀白噪声,而是采用随时间步与频率动态变化的噪声调度,更高效地将能量投向尚未解析的频段。通过主动利用模型的谱偏置,CNS系统性引导生成分布逼近真实数据流形。大量实验表明,CNS作为纯插件式推理阶段采样器替代方案,在多种架构(SiT、JiT、FLUX)上显著优于标准ODE和SDE基线。在ImageNet-256上,相较标准采样,CNS将无指导FID从8.26降至6.27(SiT-XL/2),32.39降至26.69(JiT-B/16),11.88降至8.31(JiT-H/16),且在无分类器引导下保持一致的相对提升。项目主页见https://hadardavidson.github.io/CNS/。

原文摘要 · Abstract (English)

Diffusion models achieve state-of-the-art image synthesis, with their generative trajectories fundamentally exhibiting a spectral bias, resolving low-frequency global structures early and high-frequency fine details later. Conventional stochastic differential equation (SDE) solvers fail to account for this dynamic, naively injecting uniform white noise throughout the entire process and misusing the finite energy budget. In this work, we establish a mathematical framework that reconsiders SDE inference as a targeted, frequency-decoupled energy transfer. Leveraging this framework, we introduce Colored Noise Sampling (CNS), a novel, training-free stochastic solver. Rather than injecting uniform white noise, CNS utilizes a dynamic, timestep- and frequency-dependent schedule that more efficiently allocates injected energy toward structurally unresolved frequency bands. By actively exploiting the model's inherent spectral bias, CNS systematically steers the generated distribution toward the true data manifold. Extensive experiments demonstrate that CNS significantly outperforms standard ODE and SDE baselines as a strictly plug-and-play, inference-time sampler substitution across diverse architectures (SiT, JiT, FLUX). Compared to standard sampling on ImageNet-256, CNS achieves substantial unguided FID reductions, improving from 8.26 to 6.27 on SiT-XL/2, 32.39 to 26.69 on JiT-B/16, and 11.88 to 8.31 on JiT-H/16, while yielding consistent relative FID improvements with Classifier-Free Guidance. Project page is available at https://hadardavidson.github.io/CNS/.

扩散模型采样优化频域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。