arXiv:2502.08598cs.LGstat.ML2025-02被引 2

分离总方差与信噪比,提升扩散模型采样速度与质量

Disentangling Total-Variance and Signal-to-Noise-Ratio Improves Diffusion Models

  • 将总方差与信噪比解耦,实现独立控制
  • 恒定总方差配合最优信噪比可显著提升生成质量
  • 适用于图像与分子结构生成,兼容多种求解器

扩散模型的长采样时间仍是主要瓶颈,可通过减少扩散步数缓解。但少步数下的样本质量高度依赖噪声调度,即每步噪声引入与信号衰减的方式。尽管已有工作改进了原始的方差保持与方差爆炸调度,这些方法仅被动调整总方差,缺乏直接控制。本文提出一种总方差/信噪比解耦(TV/SNR)新框架,可独立调控两者。研究发现,指数爆炸型总方差调度常可通过恒定总方差搭配相同信噪比调度得到改进。此外,推广最优传输流匹配的信噪比调度能显著提升生成性能。该发现适用于多种反向扩散求解器及应用,涵盖分子结构与图像生成。

原文摘要 · Abstract (English)

The long sampling time of diffusion models remains a significant bottleneck, which can be mitigated by reducing the number of diffusion time steps. However, the quality of samples with fewer steps is highly dependent on the noise schedule, i.e., the specific manner in which noise is introduced and the signal is reduced at each step. Although prior work has improved upon the original variance-preserving and variance-exploding schedules, these approaches $\textit{passively}$ adjust the total variance, without direct control over it. In this work, we propose a novel total-variance/signal-to-noise-ratio disentangled (TV/SNR) framework, where TV and SNR can be controlled independently. Our approach reveals that schedules where the TV explodes exponentially can often be improved by adopting a constant TV schedule while preserving the same SNR schedule. Furthermore, generalizing the SNR schedule of the optimal transport flow matching significantly improves the generation performance. Our findings hold across various reverse diffusion solvers and diverse applications, including molecular structure and image generation.

扩散模型噪声调度生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。