arXiv:2510.21890cs.LGcs.AI2025-10被引 75

揭秘扩散模型的三大数学原理,理解如何从噪声生成数据。

The Principles of Diffusion Models

  • 用三种视角统一解释扩散模型:变分、得分与流形建模。
  • 通过时间依赖速度场实现噪声到数据的连续变换路径。
  • 适合想深入理解扩散模型原理的研究者与开发者。

本书系统阐述了扩散模型发展的核心原理,追溯其数学起源,并揭示不同形式如何源于共同的思想基础。扩散模型首先定义一个前向过程,将数据逐步污染为噪声,通过一系列中间分布将数据分布与简单先验关联。目标是学习一个反向过程,使噪声逐步恢复为原始数据并重现中间状态。本书介绍三种互补视角:变分视角受变分自编码器启发,将扩散视为逐步去噪;得分视角基于能量模型,学习数据分布梯度以引导样本向高概率区域移动;流形视角与归一化流相关,将生成视为在学习的速度场下从噪声到数据的平滑轨迹。这些视角共享同一核心:时间依赖的速度场,其流形将简单先验映射至数据分布。采样即求解沿连续轨迹将噪声转化为数据的微分方程。在此基础上,本书还讨论可控生成的指导机制、高效数值求解器,以及基于扩散思想的流映射模型,可直接学习任意时间点间的映射关系。为具备基本深度学习知识的读者提供概念清晰且数学严谨的理解。配套资料可在书籍官网获取:https://the-principles-of-diffusion-models.github.io/

原文摘要 · Abstract (English)

This book presents the core principles that have guided the development of diffusion models, tracing their origins and showing how diverse formulations arise from shared mathematical ideas. Diffusion modeling starts by defining a forward process that gradually corrupts data into noise, linking the data distribution to a simple prior through a continuum of intermediate distributions. The goal is to learn a reverse process that transforms noise back into data while recovering the same intermediates. We describe three complementary views. The variational view, inspired by variational autoencoders, sees diffusion as learning to remove noise step by step. The score-based view, rooted in energy-based modeling, learns the gradient of the evolving data distribution, indicating how to nudge samples toward more likely regions. The flow-based view, related to normalizing flows, treats generation as following a smooth path that moves samples from noise to data under a learned velocity field. These perspectives share a common backbone: a time-dependent velocity field whose flow transports a simple prior to the data. Sampling then amounts to solving a differential equation that evolves noise into data along a continuous trajectory. On this foundation, the book discusses guidance for controllable generation, efficient numerical solvers, and diffusion-motivated flow-map models that learn direct mappings between arbitrary times. It provides a conceptual and mathematically grounded understanding of diffusion models for readers with basic deep-learning knowledge. Supplementary materials for the book are available at the book website: https://the-principles-of-diffusion-models.github.io/

扩散模型生成模型数学原理理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。