arXiv:2601.02499cs.LG2026-01

提出非欧空间扩散模型的新收敛理论,降低采样步长要求。

Polynomial Convergence of Riemannian Diffusion Models

  • 基于 $L_2$ 准确得分估计,用多项式小步长实现收敛
  • 无需数据分布光滑或正定,仅需标准曲率假设
  • 突破原有指数步长限制,适合非欧数据生成场景

扩散模型近年来在生成任务中表现卓越,通常假设数据位于欧氏空间。但实际中数据常位于欧氏空间的子流形上。De Bortoli 等人(2022)提出黎曼扩散模型,并证明在指数小步长下,若数据分布光滑且严格为正,且得分估计 $L_ ext{∞}$-准确,则可在沃尔什距离下保证小采样误差。本文在此基础上显著强化理论:在 $L_2$-准确得分估计下,仅需多项式小步长即可在总变差距离下保证小采样误差,且无需光滑性或正定性假设。分析依赖于热核对数梯度的 Li-Yau 估计及扰动热方程的 Minakshisundaram-Pleijel 参数展开。该方法为非欧空间扩散模型提供了更精细的分析路径。

原文摘要 · Abstract (English)

Diffusion models have demonstrated remarkable empirical success in the recent years and are considered one of the state-of-the-art generative models in modern AI. These models consist of a forward process, which gradually diffuses the data distribution to a noise distribution spanning the whole space, and a backward process, which inverts this transformation to recover the data distribution from noise. Most of the existing literature assumes that the underlying space is Euclidean. However, in many practical applications, the data are constrained to lie on a submanifold of Euclidean space. Addressing this setting, De Bortoli et al. (2022) introduced Riemannian diffusion models and proved that using an exponentially small step size yields a small sampling error in the Wasserstein distance, provided the data distribution is smooth and strictly positive, and the score estimate is $L_\infty$-accurate. In this paper, we greatly strengthen this theory by establishing that, under $L_2$-accurate score estimate, a {\em polynomially small stepsize} suffices to guarantee small sampling error in the total variation distance, without requiring smoothness or positivity of the data distribution. Our analysis only requires mild and standard curvature assumptions on the underlying manifold. The main ingredients in our analysis are Li-Yau estimate for the log-gradient of heat kernel, and Minakshisundaram-Pleijel parametrix expansion of the perturbed heat equation. Our approach opens the door to a sharper analysis of diffusion models on non-Euclidean spaces.

扩散模型黎曼几何生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。