提出一致性模型的理论框架,证明其快速生成的数学原理。
Multi-Step Consistency Models: Fast Generation with Theoretical Guarantees
- 构建可映射任意反向轨迹点的理论模型
- 仅需 $ O( ext{log}(d/\varepsilon)) $ 步即可达 $ O(\varepsilon^2) $ KL 散度
- 适用于非光滑数据分布,收敛速度领先现有方法
一致性模型近年来成为传统基于SDE的扩散模型的有力替代方案,通过极少步骤即可生成高质量样本,实现显著加速。尽管其在实践中表现优异,但缺乏充分的理论支撑。本文首次为一致性模型提供理论分析,证明其可将输入在某一时刻映射至反向轨迹的任意点。在标准假设下,使用固定步长时,仅需 $ Oig( ext{log}(d/\varepsilon)ig) $ 次迭代即可达到 $ O(\varepsilon^2) $ 的KL散度。在更弱的数据分布假设(非光滑情形)下,仍可获得类似收敛性保证,迭代次数为 $ Oig(d ext{log}(d/\varepsilon)ig) $。此外,本文还分析了模型学习的可行性,表明在平滑与非平滑场景中,采用小离散化步长即可实现准确学习。特别地,非光滑情况下的收敛速率优于现有基于SDE或ODE的分析,在最小假设下达到最优水平。
原文摘要 · Abstract (English)
Consistency models have recently emerged as a compelling alternative to traditional SDE-based diffusion models. They offer a significant acceleration in generation by producing high-quality samples in very few steps. Despite their empirical success, a proper theoretic justification for their speed-up is still lacking. In this work, we address the gap by providing a theoretical analysis of consistency models capable of mapping inputs at a given time to arbitrary points along the reverse trajectory. We show that one can achieve a KL divergence of order $ O(\varepsilon^2) $ using only $ O\left(\log\left(\frac{d}{\varepsilon}\right)\right) $ iterations with a constant step size. Additionally, under minimal assumptions on the data distribution (non smooth case) an increasingly common setting in recent diffusion model analyses we show that a similar KL convergence guarantee can be obtained, with the number of steps scaling as $ O\left(d \log\left(\frac{d}{\varepsilon}\right)\right) $. Going further, we also provide a theoretical analysis for estimation of such consistency models, concluding that accurate learning is feasible using small discretization steps, both in smooth and non-smooth settings. Notably, our results for the non-smooth case yield best in class convergence rates compared to existing SDE or ODE based analyses under minimal assumptions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。