arXiv:2508.21091cs.CV2025-08被引 9

通过误差修正与步数调整,让扩散模型推理提速一倍且画质不降。

ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion

  • 分析缓存误差来源,提出分步修正策略。
  • 在标准图像视频数据集上实现最高2倍加速,画质稳定或提升。
  • 适合追求高效生成的开发者,尤其适配高阶扩散模型。

扩散模型因迭代推理过程存在巨大计算开销。特征缓存虽能通过复用中间输出加速推理,但直接复用常导致画质明显下降。本文首次系统分析缓存引入的累积误差,将其分解为特征偏移误差(由缓存输出不准确引起)和步数放大误差(由固定采样步长下误差传播造成)。为此提出ERTACache框架,联合修正两类误差:通过离线残差分析识别可复用步数;利用轨迹感知校正系数动态调整融合区间;建立闭式残差线性化模型,对缓存引起的误差进行理论近似。该方法在多个标准图像与视频生成基准上验证,实现最高2倍推理速度提升,同时保持或提升视觉质量。在先进视频扩散模型Wan2.1上,达到2倍加速且VBench得分几乎无损,显著提升效率的同时维持基线保真度。代码已开源。

原文摘要 · Abstract (English)

Diffusion models suffer from substantial computational overhead due to their inherently iterative inference process. While feature caching offers a promising acceleration strategy by reusing intermediate outputs across timesteps, naive reuse often incurs noticeable quality degradation. In this work, we formally analyze the cumulative error introduced by caching and decompose it into two principal components: feature shift error, caused by inaccuracies in cached outputs, and step amplification error, which arises from error propagation under fixed timestep schedules. To address these issues, we propose ERTACache, a principled caching framework that jointly rectifies both error types. Our method employs an offline residual profiling stage to identify reusable steps, dynamically adjusts integration intervals via a trajectory-aware correction coefficient, and analytically approximates cache-induced errors through a closed-form residual linearization model. Together, these components enable accurate and efficient sampling under aggressive cache reuse. Extensive experiments across standard image and video generation benchmarks show that ERTACache achieves up to 2x inference speedup while consistently preserving or even improving visual quality. Notably, on the state-of-the-art Wan2.1 video diffusion model, ERTACache delivers 2x acceleration with minimal VBench degradation, effectively maintaining baseline fidelity while significantly improving efficiency. The code is available at https://github.com/bytedance/ERTACache.

扩散模型加速推理特征缓存视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。