arXiv:2505.03194cs.LG2025-05ICML被引 5

提出一致性模型在多步采样下的收敛性分析,证明其生成样本逼近真实数据分布。

Convergence Of Consistency Model With Multistep Sampling Under General Data Assumptions

  • 基于弱数据假设,分析一致性模型在近似自洽条件下的收敛性
  • 在有界支撑或尾部衰减快的分布下,生成样本与目标分布的Wasserstein距离小
  • 添加平滑扰动后,可使生成样本在总变差距离上接近真实分布

扩散模型在多个领域数据生成任务中取得显著成功,但其迭代采样过程计算成本高。一致性模型通过学习一致性函数,直接从噪声映射到数据,实现一步快速生成,并支持多步采样以提升样本质量。本文研究在训练分布下自洽性近似成立时,一致性模型的收敛性。分析仅需较弱的数据假设,适用于一类前向过程。当目标数据分布具有有界支撑或尾部衰减足够快时,生成样本与目标分布的Wasserstein距离较小;当目标分布满足一定光滑性条件时,通过额外的平滑扰动步骤,生成样本在总变差距离上也接近目标分布。文中通过两个常见前向过程的案例研究,验证了多步采样的优势。

原文摘要 · Abstract (English)

Diffusion models accomplish remarkable success in data generation tasks across various domains. However, the iterative sampling process is computationally expensive. Consistency models are proposed to learn consistency functions to map from noise to data directly, which allows one-step fast data generation and multistep sampling to improve sample quality. In this paper, we study the convergence of consistency models when the self-consistency property holds approximately under the training distribution. Our analysis requires only mild data assumption and applies to a family of forward processes. When the target data distribution has bounded support or has tails that decay sufficiently fast, we show that the samples generated by the consistency model are close to the target distribution in Wasserstein distance; when the target distribution satisfies some smoothness assumption, we show that with an additional perturbation step for smoothing, the generated samples are close to the target distribution in total variation distance. We provide two case studies with commonly chosen forward processes to demonstrate the benefit of multistep sampling.

一致性模型扩散模型收敛性分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。