arXiv:2511.04117cs.CV2025-11NeurIPS被引 1

用快慢步法加速扩散模型采样,不降质且省30%计算量

Tortoise and Hare Guidance: Accelerating Diffusion Model Inference with Multirate Integration

  • 快慢步积分:噪声用细步长算,引导信号用粗步长算
  • 减少30%函数求值次数,图像质量损失小于0.032(ImageReward)
  • 无需训练,适合追求实时高清图像生成的开发者

本文提出训练无关的Tortoise and Hare Guidance(THG)策略,加速扩散模型采样同时保持高保真生成。通过将无分类器引导(CFG)ODE重构成多速率系统,我们发现噪声估计与额外引导项对数值误差敏感度差异显著。误差界分析表明,引导分支对近似更鲁棒,存在大量可利用冗余。基于此,THG让噪声在原始细粒度时间步上用“乌龟方程”积分,引导信号仅在粗网格上用“兔子方程”积分。我们还引入(i)基于误差界自适应选择步长的采样器,以及(ii)稳定大外推跨度的引导尺度调度器。在相同计算预算下,THG将函数求值次数(NFE)减少高达30%,图像质量损失极小(ΔImageReward ≤ 0.032),优于现有最先进训练无关加速器。研究揭示了多速率形式在扩散求解器中的潜力,为无需重训练的实时高质量图像合成铺平道路。代码已开源:https://github.com/yhlee-add/THG。

原文摘要 · Abstract (English)

In this paper, we propose Tortoise and Hare Guidance (THG), a training-free strategy that accelerates diffusion sampling while maintaining high-fidelity generation. We demonstrate that the noise estimate and the additional guidance term exhibit markedly different sensitivity to numerical error by reformulating the classifier-free guidance (CFG) ODE as a multirate system of ODEs. Our error-bound analysis shows that the additional guidance branch is more robust to approximation, revealing substantial redundancy that conventional solvers fail to exploit. Building on this insight, THG significantly reduces the computation of the additional guidance: the noise estimate is integrated with the tortoise equation on the original, fine-grained timestep grid, while the additional guidance is integrated with the hare equation only on a coarse grid. We also introduce (i) an error-bound-aware timestep sampler that adaptively selects step sizes and (ii) a guidance-scale scheduler that stabilizes large extrapolation spans. THG reduces the number of function evaluations (NFE) by up to 30% with virtually no loss in generation fidelity ($Δ$ImageReward $\leq$ 0.032) and outperforms state-of-the-art CFG-based training-free accelerators under identical computation budgets. Our findings highlight the potential of multirate formulations for diffusion solvers, paving the way for real-time high-quality image synthesis without any model retraining. The source code is available at https://github.com/yhlee-add/THG.

扩散模型加速采样多速率积分无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。