arXiv:2506.21757stat.MLcs.LG2025-06NeurIPS被引 2

无需训练,采样速度提升186%,生成更细节图像。

TADA: Improved Diffusion Sampling with Training-free Augmented Dynamics

  • 用高维初始噪声替代传统噪声,减少函数求值次数
  • 在ImageNet512上比当前最优方法快186%,FID表现相当
  • 可调细节程度,适配多种扩散模型和生成场景

扩散模型在生成高保真图像方面表现出色,但采样效率较低。本文提出一种无需训练的采样方法,基于常微分方程(ODE)求解器,使采样速度相比当前最优解在ImageNet512上的对比FID指标下提升高达186%。核心思想是使用更高维度的初始噪声,从而在不修改预训练模型的前提下生成更精细的图像,同时显著降低函数评估次数。此外,该方法通过一个简单超参数即可控制生成细节水平,且无额外计算成本。我们揭示了动量扩散模型与常规扩散模型在训练范式上的根本等价性,并发现高维噪声自然具备类似随机微分方程(SDE)的特性。实验验证了该方法在EDM、EDM2和Stable-Diffusion 3等代表性预训练模型上的优异表现,覆盖像素空间与潜在空间、类别条件与文本条件等多种设置。代码已开源:https://github.com/apple/ml-tada。

原文摘要 · Abstract (English)

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve sampling speeds. In this paper, we introduce a new sampling method that is up to $186\%$ faster than the current state of the art solver for comparative FID on ImageNet512. This new sampling method is training-free and uses an ordinary differential equation (ODE) solver. The key to our method resides in using higher-dimensional initial noise, allowing to produce more detailed samples with less function evaluations from existing pretrained diffusion models. In addition, by design our solver allows to control the level of detail through a simple hyper-parameter at no extra computational cost. We present how our approach leverages momentum dynamics by establishing a fundamental equivalence between momentum diffusion models and conventional diffusion models with respect to their training paradigms. Moreover, we observe the use of higher-dimensional noise naturally exhibits characteristics similar to stochastic differential equations (SDEs). Finally, we demonstrate strong performances on a set of representative pretrained diffusion models, including EDM, EDM2, and Stable-Diffusion 3, which cover models in both pixel and latent spaces, as well as class and text conditional settings. The code is available at https://github.com/apple/ml-tada.

扩散模型采样加速高维噪声无需训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。