提出新采样方法,让扩散模型生成更快更高效
Sublinear iterations can suffice even for DDPMs
- 用随机中点改进扩散过程,提升采样精度
- 理论证明仅需√d次得分函数计算即可收敛
- 首次实现纯扩散模型的亚线性复杂度,适合实际图像生成
基于SDE的方法如去噪扩散概率模型(DDPM)在真实样本生成任务中表现出色。以往对DDPM的分析多聚焦于指数欧拉离散化,其理论保证通常至少与维度或初始Fisher信息呈线性关系。受对数凹采样工作启发,本文分析了一种新积分器——去噪扩散随机中点法(DDRaM),该方法通过引入额外的随机中点来更好逼近SDE。利用近期发展的“位移复合规则”分析框架,在适当光滑性假设下,我们证明该算法具有优异的离散化性质,只需 ilde{O}(\ oot{2}{d})次得分函数评估即可保证收敛。这是首个针对纯DDPM采样的亚线性复杂度结果——此前获得此类界的工作依赖于基于ODE的采样,并需修改采样器,偏离了实际使用方式。我们还提供了实验验证,表明该方法在预训练图像生成模型上表现良好。
原文摘要 · Abstract (English)
SDE-based methods such as denoising diffusion probabilistic models (DDPMs) have shown remarkable success in real-world sample generation tasks. Prior analyses of DDPMs have been focused on the exponential Euler discretization, showing guarantees that generally depend at least linearly on the dimension or initial Fisher information. Inspired by works in log-concave sampling (Shen and Lee, 2019), we analyze an integrator -- the denoising diffusion randomized midpoint method (DDRaM) -- that leverages an additional randomized midpoint to better approximate the SDE. Using a recently-developed analytic framework called the "shifted composition rule", we show that this algorithm enjoys favorable discretization properties under appropriate smoothness assumptions, with sublinear $\widetilde{O}(\sqrt{d})$ score evaluations needed to ensure convergence. This is the first sublinear complexity bound for pure DDPM sampling -- prior works which obtained such bounds worked instead with ODE-based sampling and had to make modifications to the sampler which deviate from how they are used in practice. We also provide experimental validation of the advantages of our method, showing that it performs well in practice with pre-trained image synthesis models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。