arXiv:2602.10825cs.CVcs.AI2026-02被引 16

提出FlowCache,让自回归视频生成速度提升6.7倍且画质几乎不变。

Flow caching for autoregressive video generation

  • 为每个视频块独立设计缓存策略,动态适应不同块的去噪特性。
  • 在MAGI-1上提速2.38倍,SkyReels-V2上提速6.7倍,质量损失极小。
  • 适合需要高效生成超长视频的研究者与开发者使用。

自回归模型(常基于Transformer架构)通过分段顺序生成内容,是生成超长视频的强大范式。然而,其逐帧生成过程极为缓慢。尽管缓存策略已被证明可加速传统视频扩散模型,但现有方法假设所有帧的去噪过程均匀一致——这一假设在自回归模型中不成立,因为相同时间步下不同视频块的相似性模式各异。本文提出FlowCache,首个专为自回归视频生成设计的缓存框架。核心洞察在于:每个视频块应保持独立的缓存策略,实现对每一段何时需重计算的细粒度控制。我们引入分块缓存策略,动态适配各块独特的去噪特征,并结合重要性-冗余联合优化的键值缓存压缩机制,在固定内存约束下维持生成质量。实验显示,该方法在MAGI-1上实现2.38倍加速,于SkyReels-V2上达6.7倍加速,质量损失极小(VBench评分分别仅上升0.87、下降0.79)。结果表明,FlowCache成功释放自回归模型在实时、超长视频生成中的潜力,建立高效视频合成的新基准。代码已开源:https://github.com/mikeallen39/FlowCache。

原文摘要 · Abstract (English)

Autoregressive models, often built on Transformer architectures, represent a powerful paradigm for generating ultra-long videos by synthesizing content in sequential chunks. However, this sequential generation process is notoriously slow. While caching strategies have proven effective for accelerating traditional video diffusion models, existing methods assume uniform denoising across all frames-an assumption that breaks down in autoregressive models where different video chunks exhibit varying similarity patterns at identical timesteps. In this paper, we present FlowCache, the first caching framework specifically designed for autoregressive video generation. Our key insight is that each video chunk should maintain independent caching policies, allowing fine-grained control over which chunks require recomputation at each timestep. We introduce a chunkwise caching strategy that dynamically adapts to the unique denoising characteristics of each chunk, complemented by a joint importance-redundancy optimized KV cache compression mechanism that maintains fixed memory bounds while preserving generation quality. Our method achieves remarkable speedups of 2.38 times on MAGI-1 and 6.7 times on SkyReels-V2, with negligible quality degradation (VBench: 0.87 increase and 0.79 decrease respectively). These results demonstrate that FlowCache successfully unlocks the potential of autoregressive models for real-time, ultra-long video generation-establishing a new benchmark for efficient video synthesis at scale. The code is available at https://github.com/mikeallen39/FlowCache.

视频生成自回归模型缓存优化Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。