用径向基函数优化扩散模型采样,速度与质量双提升
RBF-Solver: A Multistep Sampler for Diffusion Probabilistic Models via Radial Basis Functions
- 用高斯径向基函数插值模型预测,可学习参数动态调整采样路径
- 在15次评估内达FID 2.87,40次时降至2.48,优于传统多项式方法
- 适合追求高效高质生成的图像生成研究者,尤其低评估次数场景
扩散概率模型(DPMs)生成质量高,但采样计算成本大。基于多项式的多步采样器虽能加速推理,却因固定采样轨迹缺乏优化灵活性。为此,本文提出RBF-Solver,通过高斯径向基函数(Gaussian RBFs)插值模型评估结果,利用可学习的形状参数显式逼近最优采样路径。一阶时退化为欧拉法(DDIM),二阶及以上当参数趋于无穷时收敛至亚当斯法,兼容现有采样器。得益于高斯RBF的局部性,即使四阶及以上仍保持高图像保真度,而以往方法在此阶段性能下降。无条件生成中,高函数评估次数(NFE ≥ 15)下持续超越多项式采样器;在CIFAR-10上使用Score-SDE模型,15次评估得FID 2.87,40次时降至2.48。在条件生成任务中,使用Guided Diffusion模型对ImageNet 256×256图像生成,引导强度为8.0时,在低评估次数(5–10)范围内相比多项式采样器,FID降低16.12%至33.73%。
原文摘要 · Abstract (English)
Diffusion probabilistic models (DPMs) are widely adopted for their outstanding generative fidelity, yet their sampling is computationally demanding. Polynomial-based multistep samplers mitigate this cost by accelerating inference; however, despite their theoretical accuracy guarantees, they generate the sampling trajectory according to a predefined scheme, providing no flexibility for further optimization. To address this limitation, we propose RBF-Solver, a multistep diffusion sampler that interpolates model evaluations with Gaussian radial basis functions (RBFs). By leveraging learnable shape parameters in Gaussian RBFs, RBF-Solver explicitly follows optimal sampling trajectories. At first order, it reduces to the Euler method (DDIM). At second order or higher, as the shape parameters approach infinity, RBF-Solver converges to the Adams method, ensuring its compatibility with existing samplers. Owing to the locality of Gaussian RBFs, RBF-Solver maintains high image fidelity even at fourth order or higher, where previous samplers deteriorate. For unconditional generation, RBF-Solver consistently outperforms polynomial-based samplers in the high-NFE regime (NFE >= 15). On CIFAR-10 with the Score-SDE model, it achieves an FID of 2.87 with 15 function evaluations and further improves to 2.48 with 40 function evaluations. For conditional ImageNet 256 x 256 generation with the Guided Diffusion model at a guidance scale 8.0, substantial gains are achieved in the low-NFE range (5-10), yielding a 16.12-33.73% reduction in FID relative to polynomial-based samplers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。