提出新框架,让扩散模型采样更快更准。
SynBoost: A Synergistic Framework for Fast Sampling of Diffusion Models
- 拆解采样误差为两类,针对性优化
- 无需训练,可提升极少数步数下的生成质量
- 适配现有采样器,尤其适合资源受限场景
扩散概率模型(DPMs)在视觉生成中表现卓越,但其迭代采样机制导致推理速度慢。减少采样步数虽能加速,但引入显著离散化误差。现有快速采样器通过高阶求解器缓解该误差,但优化空间已近极限。本文重新分析采样误差构成,识别出两类误差:已被广泛研究的离散化误差与被忽视的近似误差。通过双误差解耦策略,揭示两类误差在采样过程中的动态关系。基于此,提出SynBoost——一种统一、无需训练的加速框架,同时抑制两类误差以最小化总误差。具体而言,通过融合当前噪声估计与更大时间步的更精确预测来降低近似误差。SynBoost可无缝集成至现有采样器中,在极低采样步数下显著提升速度与输出质量。我们在无条件与条件生成任务中,涵盖像素空间与潜在空间的DPMs上进行了充分实验验证。
原文摘要 · Abstract (English)
Diffusion probabilistic models (DPMs) have demonstrated remarkable success in visual generation. However, their iterative sampling mechanism results in slow inference speeds. While reducing sampling steps offers an intuitive acceleration strategy, it introduces significant discretization error. Existing fast samplers have made substantial progress in mitigating this error through high-order solvers, yet further optimization appears constrained. This limitation prompts a critical question: can sampling efficiency be advanced beyond current paradigms? In this work, we re-examine the composition of sampling errors and identify two distinct components: the well-studied discretization error and the under-explored approximation error. By implementing a dual-error disentanglement strategy, we elucidate the dynamic interplay between these error types across sampling steps. Building on this empirical analysis, we propose SynBoost, a unified and training-free acceleration framework that simultaneously addresses both error sources to minimize total sampling error. Concretely, it mitigates approximation error by blending the current noise estimation with a more accurate prediction from a larger timestep. SynBoost seamlessly integrates with existing samplers, substantially enhancing their speed and output quality, particularly in regimes with extremely few steps. We validate our framework through extensive experiments across unconditional and conditional generation tasks, encompassing both pixel-space and latent-space DPMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。