arXiv:2607.22199cs.LGcs.IT2026-07

证明了分数模型中分数近似能保证生成分布逼近真实分布

From Score Approximation to Distribution Approximation in Score-Based Diffusion Models

  • 通过神经网络精准近似分数函数,可保证生成分布接近真实分布
  • 推导出分布误差上界,与分数误差、噪声调度和先验不匹配相关
  • 为扩散模型的理论基础提供清晰定量支撑,适合研究者参考

基于分数的扩散模型在生成建模中取得了显著的实证成功,但其近似理论基础仍不完整。尽管经典通用近似定理表明神经网络可逼近分数函数,但这种近似是否能转化为反向扩散过程生成概率分布的逼近尚不明确。本文建立了这两个概念间的严格定量联系:若神经网络对真实分数函数的近似足够精确,则对应反向扩散模型生成的概率分布与目标数据分布之间的KL散度有界,其上界取决于前向扩散过程的终态分布与反向过程初始先验之间的不可消除偏差。我们给出了分布近似误差的显式上界,依赖于分数近似误差、扩散噪声调度及终态先验不匹配程度。分析结合了Hornik的通用近似定理、关于路径空间的Girsanov定理以及相对熵的数据处理不等式。本工作补充了近期在有限样本统计设定下研究分数近似的成果,基于经典神经网络近似理论,构建了近似理论分析框架,所得定理为神经网络对分数函数的逼近与反向扩散模型生成分布的逼近之间提供了简洁明确的保证。

原文摘要 · Abstract (English)

Score-based diffusion models have achieved remarkable empirical success in generative modeling, yet their approximation-theoretic foundations remain incomplete. In particular, although classical universal approximation theorems guarantee that neural networks can approximate score functions, it remains unclear whether such approximation guarantees translate into approximation of the probability distributions generated by reverse diffusion processes. In this paper, we establish a rigorous quantitative connection between these two notions. Specifically, we prove that if a neural network approximates the true score function sufficiently accurately, then the probability distribution generated by the corresponding reverse diffusion model is close to the target data distribution in Kullback-Leibler (KL) divergence, up to an irreducible mismatch between the terminal distribution of the forward diffusion process and the prior used to initialize the reverse process. More precisely, we derive an explicit upper bound on the distribution approximation error in terms of the score approximation error, the diffusion noise schedule, and the terminal prior mismatch. Our analysis combines Hornik's universal approximation theorem, Girsanov's theorem on path space, and the data processing inequality for relative entropy. Complementary to recent work that studies score approximation under finite-sample statistical settings and structural assumptions on the data distribution, our work develops an approximation-theoretic analysis based on classical neural network approximation theory. The resulting theorem provides a simple and explicit guarantee linking neural network approximation of score functions to approximation of the probability distributions generated by reverse diffusion models.

扩散模型分数模型理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。