arXiv:2503.16917cs.LGmath.PR2025-03被引 10

用马里亚文微积分推导扩散模型的精确梯度,为生成模型提供新数学工具。

Malliavin Calculus for Score-based Diffusion Models

  • 结合马里亚文微积分与积分换元法,推导出扩散模型得分函数的解析表达式。
  • 线性情形下结果与福克-普朗克方程解一致,非线性情形得闭式解。
  • 适用于多种扩散模型,理论严谨,适合研究生成模型数学基础者参考。

我们提出一种基于马里亚文微积分的新框架,用于推导随机微分方程(SDE)解的对数密度梯度 $ abla \ log p_t(x)$,即得分函数的精确解析表达式。该方法融合经典积分换元技巧与现代随机分析工具,如Bismut公式和马里亚文微积分,适用于线性与非线性SDE。我们建立了马里亚文导数、其对偶、马里亚文散度(Skorokhod积分)与扩散生成模型之间的严格联系,从而系统化地计算 $ abla \ log p_t(x)$。在线性情形下,我们的公式与福克-普朗克方程解所得结果一致;对于状态无关扩散系数的非线性SDE,我们推导出闭式表达式。在多个生成任务中评估表明,该框架性能可媲美当前最先进方法。结果可推广至更广泛的SDE类,为新型基于得分的扩散生成模型开辟路径。

原文摘要 · Abstract (English)

We introduce a new framework based on Malliavin calculus to derive exact analytical expressions for the score function $\nabla \log p_t(x)$, i.e., the gradient of the log-density associated with the solution to stochastic differential equations (SDEs). Our approach combines classical integration-by-parts techniques with modern stochastic analysis tools, such as Bismut's formula and Malliavin calculus, and it works for both linear and nonlinear SDEs. In doing so, we establish a rigorous connection between the Malliavin derivative, its adjoint, the Malliavin divergence (Skorokhod integral), and diffusion generative models, thereby providing a systematic method for computing $\nabla \log p_t(x)$. In the linear case, we present a detailed analysis showing that our formula coincides with the analytical score function derived from the solution of the Fokker--Planck equation. For nonlinear SDEs with state-independent diffusion coefficients, we derive a closed-form expression for $\nabla \log p_t(x)$. We evaluate the proposed framework across multiple generative tasks and find that its performance is comparable to state-of-the-art methods. These results can be generalised to broader classes of SDEs, paving the way for new score-based diffusion generative models.

扩散模型得分函数马里亚文微积分生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。