arXiv:2412.19992cs.CVcs.AI2024-12被引 2

用随机起点的高阶常微分方程加速扩散桥模型生成

An Ordinary Differential Equation Sampler with Stochastic Start for Diffusion Bridge Models

  • 设计带随机起始点的高阶常微分方程采样器,解决初始奇异问题
  • 在图像修复与转换任务中实现更低神经函数评估次数(NFE)和更优视觉质量
  • 兼容预训练模型,无需额外训练,适合高效生成场景

扩散桥模型在图像修复与转换等条件生成任务中表现优异,通过从损坏图像而非纯高斯噪声开始生成过程。然而,现有方法依赖随机微分方程采样器,推理速度慢于使用高阶常微分方程求解器的扩散模型。为此,本文提出一种带随机起始的高阶常微分方程采样器。为克服概率流常微分方程(PF-ODE)在反向过程初期的奇异性,首次反向步采用后验采样策略,确保从损坏图像到生成轨迹的平滑过渡并减少离散化误差。随后使用海恩二阶求解器求解PF-ODE,显著降低神经函数评估次数(NFE),同时保持高感知质量。方法完全兼容预训练扩散桥模型,无需额外训练。在超分辨率、JPEG恢复、Edges-to-Handbags及DIODE-Outdoor等任务上的大量实验表明,该方法在视觉质量与弗雷谢尔特征距离(FID)上均优于当前最优方法。

原文摘要 · Abstract (English)

Diffusion bridge models have demonstrated promising performance in conditional image generation tasks, such as image restoration and translation, by initializing the generative process from corrupted images instead of pure Gaussian noise. However, existing diffusion bridge models often rely on Stochastic Differential Equation (SDE) samplers, which result in slower inference speed compared to diffusion models that employ high-order Ordinary Differential Equation (ODE) solvers for acceleration. To mitigate this gap, we propose a high-order ODE sampler with a stochastic start for diffusion bridge models. To overcome the singular behavior of the probability flow ODE (PF-ODE) at the beginning of the reverse process, a posterior sampling approach was introduced at the first reverse step. The sampling was designed to ensure a smooth transition from corrupted images to the generative trajectory while reducing discretization errors. Following this stochastic start, Heun's second-order solver is applied to solve the PF-ODE, achieving high perceptual quality with significantly reduced neural function evaluations (NFEs). Our method is fully compatible with pretrained diffusion bridge models and requires no additional training. Extensive experiments on image restoration and translation tasks, including super-resolution, JPEG restoration, Edges-to-Handbags, and DIODE-Outdoor, demonstrated that our sampler outperforms state-of-the-art methods in both visual quality and Frechet Inception Distance (FID).

扩散模型常微分方程图像修复采样加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。