arXiv:2510.27562stat.MLcs.LG2025-10被引 12

首次给出DDPM在一般分布下的近最优收敛率分析,揭示其理论性能边界。

Optimal Convergence Analysis of DDPM for General Distributions

  • 引入松弛光滑性条件L,刻画实际分布的平滑程度
  • 证明收敛率达$ ilde{O}(d\min\{d,L^2\}/T^2)$,优于已有$d^2/T^2$结果
  • 建立匹配下界,说明理论紧致性,并提出与DDIM效率差异之谜

基于得分的扩散模型在高质量样本生成方面取得了显著的实证成功。其中,去噪扩散概率模型(DDPM)是最广泛使用的采样器之一,通过估计得分函数生成样本。尽管其在实践中表现优异,但对其收敛性质——尤其是理论理解——仍不充分。本文对DDPM采样器进行了精细化的收敛分析,在一般分布假设下建立了近最优的收敛速率。具体而言,我们引入了一个由常数$L$参数化的松弛光滑性条件,该条件在许多实际分布(如高斯混合模型)中取值较小。我们证明,当得分估计准确时,DDPM采样器在相对熵意义下的收敛速率为$ ilde{O}(d\min\{d,L^2\}/T^2)$,其中$d$为数据维度,$T$为迭代次数,$ ilde{O}$隐藏了$T$的多项对数因子。这一结果在$L < \sqrt{d}$时显著优于已知的最佳速率$d^2/T^2$。通过建立匹配的下界,我们表明该收敛分析对大量目标分布是紧致的。此外,该结果揭示了DDPM与DDIM在维度依赖上具有相同行为,从而引发一个有趣的问题:为何DDIM在实践中通常更快?

原文摘要 · Abstract (English)

Score-based diffusion models have achieved remarkable empirical success in generating high-quality samples from target data distributions. Among them, the Denoising Diffusion Probabilistic Model (DDPM) is one of the most widely used samplers, generating samples via estimated score functions. Despite its empirical success, a tight theoretical understanding of DDPM -- especially its convergence properties -- remains limited. In this paper, we provide a refined convergence analysis of the DDPM sampler and establish near-optimal convergence rates under general distributional assumptions. Specifically, we introduce a relaxed smoothness condition parameterized by a constant $L$, which is small for many practical distributions (e.g., Gaussian mixture models). We prove that the DDPM sampler with accurate score estimates achieves a convergence rate of $$\widetilde{O}\left(\frac{d\min\{d,L^2\}}{T^2}\right)~\text{in Kullback-Leibler divergence},$$ where $d$ is the data dimension, $T$ is the number of iterations, and $\widetilde{O}$ hides polylogarithmic factors in $T$. This result substantially improves upon the best-known $d^2/T^2$ rate when $L < \sqrt{d}$. By establishing a matching lower bound, we show that our convergence analysis is tight for a wide array of target distributions. Moreover, it reveals that DDPM and DDIM share the same dependence on $d$, raising an interesting question of why DDIM often appears empirically faster.

扩散模型收敛分析理论机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。