揭示生成漂移本质是分数匹配,解释了为何用拉普拉斯核更优。
Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspective
- 发现高斯核下漂移算子等价于平滑分布的分数差
- 提出指数带宽退火策略,将收敛时间从指数级降为对数级
- 证明停止梯度是变分框架下的必要设计,非经验技巧
基于漂移的生成建模最近通过核函数漂移算子实现了单步图像生成的最先进性能,但其理论基础尚不清晰。本文发现:在高斯核下,漂移算子恰好对应平滑分布的分数差。这解答了原作未解的三个问题:(1)漂移趋于零是否意味着分布相等;(2)如何选择核函数;(3)为何必须使用停止梯度以保证训练稳定。研究将漂移置于分数匹配框架内。通过线性化麦凯恩-弗拉索夫动力学并分析傅里叶空间中的行为,发现收敛时间具有频率依赖性,类似等离子体理论中的朗道阻尼:高斯核存在指数级高频瓶颈,可能解释为何实际偏好拉普拉斯核。为此提出指数带宽退火策略 σ(t)=σ₀e⁻ʳᵗ,使收敛时间从 exp(O(K_max²)) 降至 O(log K_max)。进一步,将漂移形式化为平滑KL散度的Wasserstein梯度流,证明停止梯度并非启发式,而是乔丹-金德尔勒赫尔-奥托(JKO)方案所要求的冻结场离散化结果;若去除则失去梯度流保证。该变分视角还提供构造新漂移算子的通用模板,我们以Sinkhorn散度漂移为例验证。分析在小规模数据集上验证,并扩展至ImageNet。
原文摘要 · Abstract (English)
Generative Modeling via Drifting~\citep{deng2026drifting} has recently achieved state-of-the-art one-step image generation through a kernel-based drift operator, yet its success is largely empirical and its theoretical foundations remain poorly understood. We observe that \emph{under a Gaussian kernel, the drift operator is exactly a score difference on smoothed distributions}. This answers three questions left open in the original work: (1) whether a vanishing drift guarantees equality of distributions ($V_{p,q}=0\Rightarrow p=q$), (2) how to choose between kernels, and (3) why the stop-gradient operator is indispensable for stable training. Our observations position drifting within the score-matching family. By linearizing the McKean-Vlasov dynamics and probing them in Fourier space, we reveal frequency-dependent convergence timescales comparable to \emph{Landau damping} in plasma kinetic theory: the Gaussian kernel suffers an exponential high-frequency bottleneck, potentially explaining the empirical preference for the Laplacian kernel. This suggests a fix: an exponential bandwidth annealing schedule $σ(t)=σ_0 e^{-rt}$ that reduces convergence time from $\exp(O(K_{\max}^2))$ to $O(\log K_{\max})$. Finally, by formalizing drifting as a Wasserstein gradient flow of the smoothed KL divergence, we prove that the stop-gradient operator is not a heuristic but is derived from the frozen-field discretization mandated by the Jordan-Kinderlehrer-Otto (JKO) scheme, and removing it severs training from any gradient-flow guarantee. This variational perspective further provides a general template for constructing novel drift operators, which we demonstrate with a Sinkhorn divergence drift. We validate our analysis on toy datasets and scale it up to ImageNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。