扩散模型其实学的是流场,而非梯度,这解释了为何不严格符合概率密度梯度也能生成好结果。
Are We Really Learning the Score Function? Reinterpreting Diffusion Models Through Wasserstein Gradient Flow Matching
- 用Wasserstein梯度流视角替代传统得分函数学习,重新解释扩散模型训练目标。
- 实验证明神经网络学到的向量场违反保守性条件,不是真正得分函数。
- 该视角更简洁,无需反向SDE理论,适合理解生成效果与误差容忍机制。
扩散模型通常被理解为学习噪声数据对数密度的得分函数,即梯度场。然而这一假设要求目标向量场是保守场,而实际使用的神经网络架构并未强制此性质。我们提供数值证据表明,训练后的扩散网络违反了保守场所需的积分与微分约束,说明其学习到的向量场并非真正的得分函数。尽管如此,这些模型仍表现出极佳的生成性能。为解释这一矛盾,我们提出新理论视角:扩散训练本质上是匹配水土引力流(Wasserstein Gradient Flow, WGF)的速度场,而非求解反向随机微分方程的得分函数。在此框架下,‘概率流’自然产生,无需依赖反向SDE理论,且能解释为何非保守误差不会破坏密度传输。结果表明,使用WGF视角可提供更清晰、优雅且理论严谨的扩散模型理解框架。
原文摘要 · Abstract (English)
Diffusion models are commonly interpreted as learning the score function, i.e., the gradient of the log-density of noisy data. However, this assumption implies that the target of learning is a conservative vector field, which is not enforced by the neural network architectures used in practice. We present numerical evidence that trained diffusion networks violate both integral and differential constraints required of true score functions, demonstrating that the learned vector fields are not conservative. Despite this, the models perform remarkably well as generative mechanisms. To explain this apparent paradox, we advocate a new theoretical perspective: diffusion training is better understood as flow matching to the velocity field of a Wasserstein Gradient Flow (WGF), rather than as score learning for a reverse-time stochastic differential equation. Under this view, the "probability flow" arises naturally from the WGF framework, eliminating the need to invoke reverse-time SDE theory and clarifying why generative sampling remains successful even when the neural vector field is not a true score. We further show that non-conservative errors from neural approximation do not necessarily harm density transport. Our results advocate for adopting the WGF perspective as a principled, elegant, and theoretically grounded framework for understanding diffusion generative models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。