解释扩散引导为何能生成结构合理样本
On the Robustness of Distribution Support under Diffusion Guidance

- 通过分析得分函数的鲁棒性支持,揭示引导机制如何保持样本在目标支撑集内
- 理论证明在精确得分函数下,引导扩散过程几乎总生成靠近目标支撑的样本
- 适用于DDIM、DDPM及多种离散化方法,为高质量生成提供理论依据
扩散引导是一种强大的技术,可实现可控且高保真的扩散模型采样。其核心是通过引入引导项修改得分函数,将生成过程导向特定条件。尽管其实验效果显著,但其理论性质仍不明确。本文通过建立支持集鲁棒性,解释了扩散引导的有效性:当具备精确得分函数时,引导扩散过程几乎总生成位于目标支撑集附近的样本。这一特性至关重要,因为偏离支撑集的样本往往结构不合理,可能影响下游任务。分析涵盖去噪扩散隐式模型(DDIM)与去噪扩散概率模型(DDPM),并适用于由指数积分器诱导的多种离散化方案。研究为扩散引导生成物理合理、结构合理的样本提供了严格理论基础。
原文摘要 · Abstract (English)
Diffusion guidance is a powerful technique that enables controllable and high-fidelity sample generation with diffusion models. At a high level, it modifies the score function by incorporating a guidance term that steers the generative process toward a desired condition. Despite its empirical success, the theoretical properties of diffusion guidance remain largely unexplored, and it is not well understood why it consistently produces high-quality samples. In this work, we explain the effectiveness of diffusion guidance by establishing a robustness of support property. Specifically, we show that, given exact access to the score functions, guided diffusion processes almost always generate samples that remain close to the target support. This property is particularly desirable, as samples that lie off the support are often structurally implausible and may adversely affect downstream tasks. Our analysis covers both Denoising Diffusion Implicit Models (DDIM) and Denoising Diffusion Probabilistic Models (DDPM), and applies to a wide range of discretization schemes induced by exponential integrators. Our results provide a rigorous foundation for understanding why diffusion guidance produces physically meaningful and structurally plausible samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。