arXiv:2511.05940math.OCcs.AI2025-11被引 3

从偏微分方程视角揭示生成扩散模型的数学原理与稳定性机制

A PDE Perspective on Generative Diffusion Models

  • 构建基于热流李-廖不等式的严格PDE框架,分析得分扩散过程的适定性
  • 证明了在数据分布紧支时,逆向扩散轨迹以√t速率收敛至数据流形
  • 为得分函数设计、损失定义和停止时间选择提供理论指导,适合理论研究者

得分驱动的扩散模型已成为一类强大的生成方法,在多个领域达到顶尖性能。尽管其经验表现优异,但其背后的随机与偏微分方程的动力学稳定性与一致性仍不清晰。本文发展了一套严格的偏微分方程(PDE)框架来刻画得分扩散过程。基于热流的李-廖微分不等式,我们证明了相关得分福克-普朗克动力学的适定性,并导出了精确的$L^p$-稳定性估计,提供了其时间演化的数学一致描述。通过熵稳定性方法,进一步表明当数据分布具有紧支集且初始化方案广泛时,扩散模型的逆向动力学在$t \to 0$时以$√{t}$阶速率集中于数据流形。这些结果给出了理论保证:在精确得分引导下,扩散轨迹能返回数据流形并保持拟合保真度。研究还为模型设计提供了实践启示,包括得分函数构造、损失函数制定与停止时间选择的合理准则。整体框架实现了生成能力与拟合保真度之间权衡的定量理解,统一了严谨分析与模型设计的数学视角。

原文摘要 · Abstract (English)

Score-based diffusion models have emerged as a powerful class of generative methods, achieving state-of-the-art performance across diverse domains. Despite their empirical success, the mathematical foundations of those models remain only partially understood, particularly regarding the stability and consistency of the underlying stochastic and partial differential equations governing their dynamics. In this work, we develop a rigorous partial differential equation (PDE) framework for score-based diffusion processes. Building on the Li--Yau differential inequality for the heat flow, we prove well-posedness and derive sharp $L^p$-stability estimates for the associated score-based Fokker--Planck dynamics, providing a mathematically consistent description of their temporal evolution. Through entropy stability methods, we further show that the reverse-time dynamics of diffusion models concentrate on the data manifold for compactly supported data distributions and a broad class of initialization schemes, with a concentration rate of order $\sqrt{t}$ as $t \to 0$. These results yield a theoretical guarantee that, under exact score guidance, diffusion trajectories return to the data manifold while preserving imitation fidelity. Our findings also provide practical insights for designing diffusion models, including principled criteria for score-function construction, loss formulation, and stopping-time selection. Altogether, this framework provides a quantitative understanding of the trade-off between generative capacity and imitation fidelity, bridging rigorous analysis and model design within a unified mathematical perspective.

扩散模型偏微分方程理论分析得分网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。