arXiv:2502.07856cs.CVcs.AI2025-02ICLR被引 7

提出MaRS采样器,让均值回复扩散模型采样快10到20倍

MaRS: A Fast Sampler for Mean Reverting Diffusion based on ODE and SDE Solvers

  • 通过解析求解反向SDE和概率流ODE,结合神经网络参数化积分项
  • 在不训练的情况下,仅需数十次函数求值即可生成高质量图像
  • 适用于噪声预测、数据预测等主流参数化,适合图像修复等可控生成任务

在扩散模型的应用中,可控生成具有实际意义但面临挑战。现有方法多聚焦于修改得分函数,而均值回复(MR)扩散模型直接修改随机微分方程(SDE)结构,使图像条件融入更自然。然而,当前无训练的快速采样器不适用于MR扩散模型,导致其需数百次函数求值(NFE)才能生成高质量样本。本文提出新算法MaRS(MR Sampler),求解与MR扩散相关的反向SDE和概率流常微分方程(PF-ODE),推导出半解析解:由解析函数和由神经网络参数化的积分项组成。基于该解,可在更少步数内生成高质量样本。本方法无需训练,支持主流参数化形式(包括噪声预测、数据预测、速度预测)。大量实验表明,该算法在十项不同图像修复任务中实现10至20倍加速,同时保持高采样质量,显著提升MR扩散模型在可控生成中的实用性。

原文摘要 · Abstract (English)

In applications of diffusion models, controllable generation is of practical significance, but is also challenging. Current methods for controllable generation primarily focus on modifying the score function of diffusion models, while Mean Reverting (MR) Diffusion directly modifies the structure of the stochastic differential equation (SDE), making the incorporation of image conditions simpler and more natural. However, current training-free fast samplers are not directly applicable to MR Diffusion. And thus MR Diffusion requires hundreds of NFEs (number of function evaluations) to obtain high-quality samples. In this paper, we propose a new algorithm named MaRS (MR Sampler) to reduce the sampling NFEs of MR Diffusion. We solve the reverse-time SDE and the probability flow ordinary differential equation (PF-ODE) associated with MR Diffusion, and derive semi-analytical solutions. The solutions consist of an analytical function and an integral parameterized by a neural network. Based on this solution, we can generate high-quality samples in fewer steps. Our approach does not require training and supports all mainstream parameterizations, including noise prediction, data prediction and velocity prediction. Extensive experiments demonstrate that MR Sampler maintains high sampling quality with a speedup of 10 to 20 times across ten different image restoration tasks. Our algorithm accelerates the sampling procedure of MR Diffusion, making it more practical in controllable generation.

扩散模型采样加速可控生成均值回复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。