arXiv:2605.09681cs.CV2026-05被引 4

通过分类型压缩注意力缓存,让自回归视频生成更快更省内存。

Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models

论文配图:Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models
图 1 · 摘自论文原文
  • 按注意力头功能分为静态与动态两类,分别采用结构化剪枝和相似性剪枝。
  • 在480P下实现29帧/秒生成速度,内存减少30%,提速1.5倍。
  • 适合追求实时视频生成的开发者,尤其在高分辨率场景表现优异。

自回归(AR)视频扩散模型采用流式生成框架,支持长时序视频的实时生成,如Self Forcing训练范式所示。然而,现有模型因历史帧间冗余的键值(KV)缓存导致显著的注意力复杂度和严重的内存开销,限制了可扩展性。本文通过引入KV缓存压缩解决该问题。我们发现主流AR扩散模型中注意力头具有显著不同的注意力模式和稳定的功能角色。基于此,将注意力头分为两类:静态头关注自回归块间的转换和帧内保真度,动态头控制帧间运动与一致性。提出Forcing-KV混合压缩策略:对静态头进行结构化静态剪枝,对动态头基于分段相似性进行动态剪枝。在保持输出质量前提下,单张NVIDIA H200 GPU上实现超过29帧/秒的生成速度,缓存内存减少30%,在480P分辨率下相较LongLive和Self Forcing分别提速1.35倍和1.50倍,1080P下进一步达到2.82倍提速。代码与演示视频见https://zju-jiyicheng.github.io/Forcing-KV-Page。

原文摘要 · Abstract (English)

Autoregressive (AR) video diffusion models adopt a streaming generation framework, enabling long-horizon video generation with real-time responsiveness, as exemplified by the Self Forcing training paradigm. However, existing AR video diffusion models still suffer from significant attention complexity and severe memory overhead due to the redundant key-value (KV) caches across historical frames, which limits scalability. In this paper, we tackle this challenge by introducing KV cache compression into autoregressive video diffusion. We observe that attention heads in mainstream AR diffusion models exhibit markedly distinct attention patterns and functional roles that remain stable across samples and denoising steps. Building on our empirical study of head-wise functional specialization, we divide the attention heads into two categories: static heads, which focus on transitions across autoregressive chunks and intra-frame fidelity, and dynamic heads, which govern inter-frame motion and consistency. We then propose Forcing-KV, a hybrid KV cache compression strategy that performs structured static pruning for static heads and dynamic pruning based on segment-wise similarity for dynamic heads. While maintaining output quality, our method achieves a generation speed of over 29 frames per second on a single NVIDIA H200 GPU along with 30% cache memory reduction, delivering up to 1.35x and 1.50x speedups on LongLive and Self Forcing at 480P resolution, and further scaling to 2.82x speedup at 1080P resolution. Code and demo videos are provided at https://zju-jiyicheng.github.io/Forcing-KV-Page.

视频生成扩散模型缓存压缩自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。