arXiv:2605.01725cs.CVcs.AI2026-05被引 2

根据运动动态智能缓存,让视频生成快10倍还不失真。

Motion-Aware Caching for Efficient Autoregressive Video Generation

论文配图:Motion-Aware Caching for Efficient Autoregressive Video Generation
图 1 · 摘自论文原文
  • 用帧间差异做运动代理,动态调整每像素缓存频率
  • 在SkyReels-V2上提速6.28倍,质量仅降1%
  • 适合追求高速生成且对画质要求高的研究者

自回归视频生成理论上可实现长视频合成,但受限于逐步去噪带来的计算开销。现有缓存复用策略依赖粗粒度分块跳过,无法捕捉像素级运动动态。我们从理论上建立缓存误差与残差不稳定的关联,提出MotionCache:利用帧间差异作为轻量级运动代理,采用粗到精策略——先通过预热阶段保证语义连贯性,再按运动强度动态调整各标记的更新频率。在SkyReels-V2和MAGI-1等先进模型上的实验表明,MotionCache分别实现6.28倍和1.64倍加速,同时生成质量损失极小(VBench评分下降1%和0.01%)。代码已开源。

原文摘要 · Abstract (English)

Autoregressive video generation paradigms offer theoretical promise for long video synthesis, yet their practical deployment is hindered by the computational burden of sequential iterative denoising. While cache reuse strategies can accelerate generation by skipping redundant denoising steps, existing methods rely on coarse-grained chunk-level skipping that fails to capture fine-grained pixel dynamics. This oversight is critical: pixels with high motion require more denoising steps to prevent error accumulation, while static pixels tolerate aggressive skipping. We formalize this insight theoretically by linking cache errors to residual instability, and propose MotionCache, a motion-aware cache framework that exploits inter-frame differences as a lightweight proxy for pixel-level motion characteristics. MotionCache employs a coarse-to-fine strategy: an initial warm-up phase establishes semantic coherence, followed by motion-weighted cache reuse that dynamically adjusts update frequencies per token. Extensive experiments on state-of-the-art models like SkyReels-V2 and MAGI-1 demonstrate that MotionCache achieves significant speedups of $\textbf{6.28}\times$ and $\textbf{1.64}\times$ respectively, while effectively preserving generation quality (VBench: $1\%\downarrow$ and $0.01\%\downarrow$ respectively). The code is available at https://github.com/ywlq/MotionCache.

视频生成缓存优化运动感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。