用单步生成实现快速高保真图像合成,突破扩散模型采样慢瓶颈。
One-Step Generative Modeling via Wasserstein Gradient Flows

- 通过Wasserstein梯度流定义分布演化路径,再压缩为单步生成
- ImageNet 256×256生成达1.29 FID,模式覆盖更全
- 采样速度比同类扩散模型快约100倍,适合实时应用
扩散模型和基于流的方法在图像生成上表现优异,但采样成本高,需多次迭代。本文提出W-Flow框架,训练一个静态神经生成器,将简单参考分布样本一步转换为目标数据分布样本。方法分两步:首先通过最小化能量泛函的Wasserstein梯度流定义从参考分布到目标分布的演化路径;其次训练生成器将该演化压缩为单步生成。能量泛函采用Sinkhorn散度,导出高效最优传输更新规则,能捕捉全局分布差异并提升目标分布覆盖性。理论上证明了有限样本训练动态在合理假设下收敛至连续时间分布动态。实验表明,W-Flow在单步ImageNet 256×256生成上达到1.29 FID,优于现有方法,且模式覆盖更全面;相比具有相似FID的多步扩散模型,采样速度提升约100倍。结果表明Wasserstein梯度流为快速高保真生成建模提供了原理性有效基础。
原文摘要 · Abstract (English)
Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it requires many iterative updates. We introduce W-Flow, a framework for training a generator that transforms samples from a simple reference distribution into samples from a target data distribution in a single step. This is achieved in two steps: we first define an evolution from the reference distribution to the target distribution through a Wasserstein gradient flow that minimizes an energy functional; second, we train a static neural generator to compress this evolution into one-step generation. We instantiate the energy functional with the Sinkhorn divergence, which yields an efficient optimal-transport-based update rule that captures global distributional discrepancy and improves coverage of the target distribution. We further prove that the finite-sample training dynamics converge to the continuous-time distributional dynamics under suitable assumptions. Empirically, W-Flow sets a new state of the art for one-step ImageNet 256$\times$256 generation, achieving 1.29 FID, with improved mode coverage and domain transfer. Compared to multi-step diffusion models with similar FID scores, our method yields approximately 100$\times$ faster sampling. These results show that Wasserstein gradient flows provide a principled and effective foundation for fast and high-fidelity generative modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。