arXiv:2410.22637cs.LGcs.CV2024-10NeurIPS被引 31

让扩散模型生成更快更清晰,只需少量步骤即可完成。

Consistency Diffusion Bridge Models

  • 通过学习概率流微分方程的一致性函数,实现快速采样
  • 在64×64到256×256图像上提速4至50倍,质量更优
  • 适用于图像翻译、语义插值等任务,部署更高效

扩散模型(DMs)已成为多种领域生成建模的主流范式,通过从噪声到数据的学习随机过程实现。近期提出的扩散去噪桥模型(DDBMs)在具有耦合数据分布的任务中表现优异,如图像到图像转换。然而,传统DDBM采样需数百次网络评估,计算成本高,限制实际应用。受一致性模型启发,本文学习DDBM概率流常微分方程(PF-ODE)的一致性函数,可直接从轨迹任意点预测起始步解。基于专用通用形式的ODE求解器,提出两种范式:一致性桥蒸馏与一致性桥训练,适用于多种设计选择。实验表明,所提方法在64×64至256×256像素任务中采样速度提升4至50倍,相同步数下生成质量更优,并支持语义插值等下游任务。

原文摘要 · Abstract (English)

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of generative modeling that builds stochastic processes between fixed data endpoints based on a reference diffusion process, have achieved empirical success across tasks with coupled data distribution, such as image-to-image translation. However, DDBM's sampling process typically requires hundreds of network evaluations to achieve decent performance, which may impede their practical deployment due to high computational demands. In this work, inspired by the recent advance of consistency models in DMs, we tackle this problem by learning the consistency function of the probability-flow ordinary differential equation (PF-ODE) of DDBMs, which directly predicts the solution at a starting step given any point on the ODE trajectory. Based on a dedicated general-form ODE solver, we propose two paradigms: consistency bridge distillation and consistency bridge training, which is flexible to apply on DDBMs with broad design choices. Experimental results show that our proposed method could sample $4\times$ to $50\times$ faster than the base DDBM and produce better visual quality given the same step in various tasks with pixel resolution ranging from $64 \times 64$ to $256 \times 256$, as well as supporting downstream tasks such as semantic interpolation in the data space.

扩散模型生成模型加速采样图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。