用物理涨落分析扩散模型采样过程,发现采样有突变阶段。
Cross-fluctuation phase transitions reveal sampling dynamics in diffusion models
- 通过交叉涨落统计量捕捉采样中的突变行为。
- 采样过程出现离散相变,能加速生成与提升零样本任务效果。
- 适用于各类扩散模型,无需重训练即可提速增效。
我们利用统计物理中的交叉涨落(cross-fluctuations)分析基于得分的扩散模型中分布采样的动态演化。具体而言,从无偏各向同性正态分布出发,样本经历一系列尖锐的离散相变,逐步形成目标分布的显著结构,并揭示更精细特征。该过程可逆:反向时中间状态逐渐融合,沿路径回溯至初始分布。我们证明这些相变可被检测为n阶交叉涨落的不连续点。对于方差保持型SDE,我们推导出交叉涨落的闭式表达,可高效计算反向轨迹。直接检测这些相变可显著提升采样效率,加速类别条件生成与稀有类别生成,并在无需昂贵网格搜索或重训练的情况下,改善图像分类与风格迁移两项零样本任务性能。此外,这一视角将经典有限马尔可夫链的耦合与混合理论统一于连续动力学框架,扩展至随机SDE与非马尔可夫采样器。因此,本框架连接了离散马尔可夫链理论、相变分析与现代生成建模。
原文摘要 · Abstract (English)
We analyse how the sampling dynamics of distributions evolve in score-based diffusion models using cross-fluctuations, a centered-moment statistic from statistical physics. Specifically, we show that starting from an unbiased isotropic normal distribution, samples undergo sharp, discrete transitions, eventually forming distinct events of a desired distribution while progressively revealing finer structure. As this process is reversible, these transitions also occur in reverse, where intermediate states progressively merge, tracing a path back to the initial distribution. We demonstrate that these transitions can be detected as discontinuities in $n^{\text{th}}$-order cross-fluctuations. For variance-preserving SDEs, we derive a closed-form for these cross-fluctuations that is efficiently computable for the reverse trajectory. We find that detecting these transitions directly boosts sampling efficiency, accelerates class-conditional and rare-class generation, and improves two zero-shot tasks--image classification and style transfer--without expensive grid search or retraining. We also show that this viewpoint unifies classical coupling and mixing from finite Markov chains with continuous dynamics while extending to stochastic SDEs and non Markovian samplers. Our framework therefore bridges discrete Markov chain theory, phase analysis, and modern generative modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。