arXiv:2604.01552cs.LG2026-04被引 2

用二阶预测加速扩散模型,3.2倍提速仍保画质

ZEUS: Accelerating Diffusion Models with Only Second-Order Predictor

  • 用二阶预测器减少去噪器调用次数,避免误差累积
  • 在图像视频生成中实现最高3.2倍端到端提速,画质无损
  • 无需改架构、零额外开销,适配各类模型与求解器

去噪生成模型虽能生成高保真内容,但采样过程需多次调用去噪器,导致推理延迟。现有训练自由加速方法或稀疏化网络结构,或缩短采样轨迹,但复杂度偏高:高阶预测器在激进加速下会放大误差,结构调整又影响部署。当加速超过2倍时,步跳机制产生结构稀缺——每局部窗口最多一次新评估,仅能依赖输出值及其反向差分作为因果依据。基于此,我们提出ZEUS,采用二阶预测器减少去噪器调用,并引入交错方案稳定连续跳步,避免连续外推。ZEUS几乎不增加开销,无需特征缓存或架构修改,兼容不同主干、预测目标与求解器选择。在图像与视频生成任务中,其速度-质量表现持续优于近期训练自由基线,最高达3.2倍端到端加速,同时保持感知质量。代码已开源:https://github.com/Ting-Justin-Jiang/ZEUS。

原文摘要 · Abstract (English)

Denoising generative models deliver high-fidelity generation but remain bottlenecked by inference latency due to the many iterative denoiser calls required during sampling. Training-free acceleration methods reduce latency by either sparsifying the model architecture or shortening the sampling trajectory. Current training-free acceleration methods are more complex than necessary: higher-order predictors amplify error under aggressive speedups, and architectural modifications hinder deployment. Beyond 2x acceleration, step skipping creates structural scarcity -- at most one fresh evaluation per local window -- leaving the computed output and its backward difference as the only causally grounded information. Based on this, we propose ZEUS, an acceleration method that predicts reduced denoiser evaluations using a second-order predictor, and stabilizes aggressive consecutive skipping with an interleaved scheme that avoids back-to-back extrapolations. ZEUS adds essentially zero overhead, no feature caches, and no architectural modifications, and it is compatible with different backbones, prediction objectives, and solver choices. Across image and video generation, ZEUS consistently improves the speed-fidelity performance over recent training-free baselines, achieving up to 3.2x end-to-end speedup while maintaining perceptual quality. Our code is available at: https://github.com/Ting-Justin-Jiang/ZEUS.

扩散模型加速生成二阶预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。