arXiv:2608.13043cs.AIcs.CV2026-08

优化扩散模型缓存策略,让计算资源用在提升画质的关键位置

From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion

论文配图:From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
图 1 · 摘自论文原文
  • 基于误差传播理论设计全局影响评估机制
  • 在Wan2.1模型上实现2.17倍加速且LPIPS降至0.0316
  • 适合追求生成质量与推理效率平衡的研究者

扩散模型在视觉生成中表现优异,但推理开销巨大。虽然基于缓存的加速方法已有进展,但现有策略依赖局部相似性启发,与最终生成质量严重脱节。原因在于去噪轨迹中误差非均匀传播与累积。为此,我们提出全局影响缓存(GCache)。首先建立误差传播的严格上界理论;针对复杂非凸模型该上界过于保守的问题,采用Bernstein形式重参数化传播指数,并将缓存策略搜索转化为双层优化问题。内层目标寻找最优复用策略,外层目标使误差加权函数与生成质量损失对齐。该框架有效融合理论严谨性与实际性能,学会在最影响视觉保真度的位置优先分配计算资源。大量实验表明,GCache在图像与视频生成任务中均优于现有缓存策略。尤其在当前最先进的Wan2.1视频扩散模型上,保持2.17倍加速的同时,显著提升生成质量,将LPIPS从0.1095降低至0.0316。

原文摘要 · Abstract (English)

Diffusion models have achieved dominant performance in visual generation but suffer from substantial inference overhead. While cache-based acceleration has emerged as a promising solution, existing policies rely on local similarity heuristics, which we identify as being significantly misaligned with final generation quality. This discrepancy stems from the non-uniform propagation and accumulation of errors along the denoising trajectory. To address this, we propose Global-Impact Cache (GCache). We first establish a rigorous theoretical characterization of the error propagation upper bound. Recognizing that this bound can be overly conservative for complex, highly non-convex diffusion models, we further reparameterize the propagation exponent with a Bernstein form and reformulate cache policy search as a bilevel optimization problem. In detail, GCache identifies an optimal reuse policy in the inner objective while aligning the error-weighting function with generation quality loss in the outer objective. This framework effectively reconciles theoretical rigor with empirical performance, learning to prioritize computation where it most impacts visual fidelity. Extensive experiments demonstrate that GCache consistently outperforms prior caching strategies on both video and image generation. Notably, on the state-of-the-art Wan2.1 video diffusion model, GCache maintains a 2.17x speedup while significantly enhancing generation quality, reducing LPIPS from 0.1095 to 0.0316.

扩散模型缓存优化生成质量视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。