揭示扩散生成模型的得分场遵循伯格斯方程结构,解释模式分裂机制。
Score Shocks: The Burgers Equation Structure of Diffusion Generative Models
- 用伯格斯型偏微分方程描述得分场演化,捕捉模式间界面动态。
- 在对称双高斯混合中,预测临界扩散时间与已有谱准则一致。
- 发现得分误差在模式界面呈指数放大,适合研究生成模型稳定性。
我们通过伯格斯型演化规律分析扩散生成模型的得分场。对于VE扩散,热演化数据密度表明得分服从一维黏性伯格斯方程及R^d中的无旋向量伯格斯系统,从偏微分方程视角揭示了‘物种分化’过程即模式界面的锐化现象。对于任意噪声密度的二元分解为两个正热解,得分可分解为光滑背景项与由分量对数比决定的通用 anh界面项;在规则二元模式边界附近,此分解给出物种分化的法向判据。在对称双高斯混合情形下,该判据与得分中点导数检测到的临界扩散时间一致,并符合Biroli、Bonnaire、de Bortoli与Mézard(2024)的谱判据。减去背景漂移后,模式间层具有局部伯格斯 anh轮廓,对称高斯情形下扩展为全局轮廓,宽度为σ_τ²/a。我们还量化了该层内得分误差的指数级放大,证明伯格斯动力学保持无旋性,并通过变量变换将VP-SDE简化为VE情形,得到闭式表达的VP物种分化时间。高斯混合公式经机器精度验证,局部定理在四次双阱模型上数值检验通过。
原文摘要 · Abstract (English)
We analyze the score field of a diffusion generative model through a Burgers-type evolution law. For VE diffusion, the heat-evolved data density implies that the score obeys viscous Burgers in one dimension and the corresponding irrotational vector Burgers system in $\R^d$, giving a PDE view of \emph{speciation transitions} as the sharpening of inter-mode interfaces. For any binary decomposition of the noised density into two positive heat solutions, the score separates into a smooth background and a universal $\tanh$ interfacial term determined by the component log-ratio; near a regular binary mode boundary this yields a normal criterion for speciation. In symmetric binary Gaussian mixtures, the criterion recovers the critical diffusion time detected by the midpoint derivative of the score and agrees with the spectral criterion of Biroli, Bonnaire, de~Bortoli, and Mézard (2024). After subtracting the background drift, the inter-mode layer has a local Burgers $\tanh$ profile, which becomes global in the symmetric Gaussian case with width $σ_τ^2/a$. We also quantify exponential amplification of score errors across this layer, show that Burgers dynamics preserves irrotationality, and use a change of variables to reduce the VP-SDE to the VE case, yielding a closed-form VP speciation time. Gaussian-mixture formulas are verified to machine precision, and the local theorem is checked numerically on a quartic double-well.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。