首次为非光滑数据分布的生成模型提供精确收敛保证
Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients
- 基于半凸性分析,放宽了对梯度平滑性的传统要求
- 在高维下实现√d量级的最优收敛速度,且速率阶为1
- 适用于混合高斯、双阱势等复杂实际分布,理论更贴近真实场景
基于得分的生成模型(SGMs)通过加高斯噪声并学习反向去噪过程来逼近数据分布。这类模型在计算机视觉、音频生成、强化学习和计算生物学等领域表现卓越。然而,现有关于Wasserstein-2收敛性的分析通常依赖于强正则性假设,如数据分布的光滑性或严格对数凹性,这些条件在实践中很少满足。本文首次建立了针对具有潜在不连续梯度的半凸分布的非渐近Wasserstein-2收敛保证。上界显式且紧致,对数据维度d的依赖达到最优O(√d),收敛速率阶为1。该框架涵盖多种实际相关分布,包括对称修改半正态分布、高斯混合、双阱势和弹性网势。通过在不假设势函数可微的前提下利用半凸性,本结果显著拓展了SGM的理论基础,弥合了其在非光滑复杂数据场景下的经验成功与严格理论保障之间的差距。
原文摘要 · Abstract (English)
Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and generating diverse samples, achieving state-of-the-art performance across domains such as computer vision, audio generation, reinforcement learning, and computational biology. Despite their empirical success, existing Wasserstein-2 convergence analysis typically assume strong regularity conditions-such as smoothness or strict log-concavity of the data distribution-that are rarely satisfied in practice. In this work, we establish the first non-asymptotic Wasserstein-2 convergence guarantees for SGMs targeting semiconvex distributions with potentially discontinuous gradients. Our upper bounds are explicit and sharp in key parameters, achieving optimal dependence of $O(\sqrt{d})$ on the data dimension $d$ and convergence rate of order one. The framework accommodates a wide class of practically relevant distributions, including symmetric modified half-normal distributions, Gaussian mixtures, double-well potentials, and elastic net potentials. By leveraging semiconvexity without requiring smoothness assumptions on the potential such as differentiability, our results substantially broaden the theoretical foundations of SGMs, bridging the gap between empirical success and rigorous guarantees in non-smooth, complex data regimes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。