arXiv:2507.05550stat.MLcs.LG2025-07被引 3

用随机分析方法推导扩散生成模型的精确得分函数表达式。

A Malliavin calculus approach to score functions in diffusion generative models

  • 结合马利亚文微分与新布斯米特公式,推导得分函数闭式解。
  • 结果仅依赖一阶二阶变分过程,无需显式计算马利亚文导数。
  • 为复杂分布采样和新型生成算法设计提供理论支持。

基于扩散的生成模型近年来成为建模复杂数据分布的强大工具。这类模型旨在学习得分函数,通过确定性或随机微分方程(SDE)将已知概率分布映射到目标数据分布。得分函数通常通过去噪、切片得分匹配、赫瓦里恩方法或薛定谔桥等近似技术从数据中估计。本文针对一类广义非线性扩散生成模型,首次推导出得分函数的精确闭式表达式。方法融合现代随机分析工具,包括马利亚文导数及其对偶算子(斯科罗霍德积分或马利亚文散度),并引入新的布斯米特型公式。所得表达式完全以一阶和二阶变分过程表示,所有马利亚文导数被系统消除,显著提升实际应用性。该理论框架为生成建模中的得分估计提供了原则性基础,可推动新型采样算法的设计,并可拓展至更广泛的随机微分方程类别,开启得分驱动扩散模型的新研究方向。

原文摘要 · Abstract (English)

Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the target data distribution via deterministic or stochastic differential equations (SDEs). The score function is typically estimated from data using a variety of approximation techniques, such as denoising or sliced score matching, Hyvärien's method, or Schrödinger bridges. In this paper, we derive an exact, closed-form, expression for the score function for a broad class of nonlinear diffusion generative models. Our approach combines modern stochastic analysis tools such as Malliavin derivatives and their adjoint operators (Skorokhod integrals or Malliavin Divergence) with a new Bismut-type formula. The resulting expression for the score function can be written entirely in terms of the first and second variation processes, with all Malliavin derivatives systematically eliminated, thereby enhancing its practical applicability. The theoretical framework presented in this work offers a principled foundation for advancing score estimation methods in generative modelling, enabling the design of new sampling algorithms for complex probability distributions. Our results can be extended to broader classes of stochastic differential equations, opening new directions for the development of score-based diffusion generative models.

生成模型扩散模型随机分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。