无需训练,动态缓存复用计算结果,让视频生成快3倍以上
Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching
- 运行时自适应缓存机制,复用历史计算向量避免重复运算
- 在OpenSora等模型上提速2.1-3.3倍,PSNR提升最高达36%
- 零预处理、免调参,适合研究与实际部署场景
视频生成模型表现卓越,但其广泛应用受限于推断速度慢和计算成本高,主要源于去噪过程的迭代特性。本文提出EasyCache,一种针对视频扩散模型的训练免费加速框架。该框架引入轻量级、运行时自适应的缓存机制,动态复用先前计算的变换向量,避免推理过程中的冗余计算。与以往方法不同,EasyCache无需离线分析、预计算或大量参数调优。我们在OpenSora、Wan2.1和HunyuanVideo等多个大规模视频生成模型上进行了全面评估,结果表明该方法在保持高质量视觉效果的同时,相较原始基线实现高达2.1-3.3倍的推理加速,且相比当前最优方法(SOTA)PSNR最高提升36%。EasyCache为高质量视频生成提供了高效且易用的解决方案,适用于科研与实际应用。代码已开源:https://github.com/H-EmbodVis/EasyCache。
原文摘要 · Abstract (English)
Video generation models have demonstrated remarkable performance, yet their broader adoption remains constrained by slow inference speeds and substantial computational costs, primarily due to the iterative nature of the denoising process. Addressing this bottleneck is essential for democratizing advanced video synthesis technologies and enabling their integration into real-world applications. This work proposes EasyCache, a training-free acceleration framework for video diffusion models. EasyCache introduces a lightweight, runtime-adaptive caching mechanism that dynamically reuses previously computed transformation vectors, avoiding redundant computations during inference. Unlike prior approaches, EasyCache requires no offline profiling, pre-computation, or extensive parameter tuning. We conduct comprehensive studies on various large-scale video generation models, including OpenSora, Wan2.1, and HunyuanVideo. Our method achieves leading acceleration performance, reducing inference time by up to 2.1-3.3$\times$ compared to the original baselines while maintaining high visual fidelity with a significant up to 36% PSNR improvement compared to the previous SOTA method. This improvement makes our EasyCache a efficient and highly accessible solution for high-quality video generation in both research and practical applications. The code is available at https://github.com/H-EmbodVis/EasyCache.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。