统一解释扩散、得分和流匹配模型的数学本质
A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
- 用时间依赖向量场统一描述三类生成模型的演化过程
- 证明概率流ODE与扩散模型共享相同分布,连接生成与似然方法
- 揭示流匹配与得分训练在不同插值下的等价与差异
我们综述基于连续时间动态将简单先验分布转化为数据分布的生成建模方法。提出一个统一框架:扩散模型、得分生成模型和流匹配均是学习一个随时间变化的向量场,该场诱导一族满足连续性方程和福克-普朗克方程的边缘分布 (ρ_t)_{t ∈ [0,1]}。这一理论具有时效性,因这些方法正趋于方法论趋同,但符号体系混乱与不同推导方式仍掩盖其共同结构及采样、稳定性与计算间的实际权衡。在该框架下,(i) 将扩散与得分模型的反向采样视为受控随机动力学;(ii) 证明概率流ODE产生相同的边缘分布,并将扩散模型与基于似然的归一化流相连接;(iii) 将流匹配解释为在选定插值下对速度场的直接回归,明确其与得分训练何时等价或不同。我们在统一符号下比较目标函数、采样方案与离散化误差,讨论与薛定谔桥和熵正则最优传输的联系,并总结逼近、稳定性和可扩展性方面的理论保证与开放问题。
原文摘要 · Abstract (English)
We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models, score-based generative models, and flow matching are instances of learning a time-dependent vector field that induces a family of marginals $(ρ_t)_{t \in [0,1]}$ governed by continuity and Fokker-Planck equations. Such a unified theory is timely because these methods are converging methodologically, yet fragmented notation and competing derivations continue to obscure their shared structure and the practical tradeoffs governing sampling, stability, and computation. Within this framework, we (i) derive reverse-time sampling for diffusion and score-based models as controlled stochastic dynamics, (ii) show that the probability flow ODE yields identical marginals and connects diffusion to likelihood-based normalizing flows, and (iii) interpret flow matching as direct regression of the velocity field under a chosen interpolation, clarifying when it coincides with or differs from score-based training. We compare objectives, sampling schemes, and discretization errors under unified notation, discuss connections to Schrodinger bridges and entropic optimal transport, and summarize theoretical guarantees and open problems on approximation, stability, and scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。