arXiv:2605.18346cs.CVcs.AI2026-05

提出一种无需训练的视频生成高效缓存选择方法,提升质量与速度。

Focused Forcing: Content-Aware Per-Frame KV Selection for Efficient Autoregressive Video Diffusion

论文配图:Focused Forcing: Content-Aware Per-Frame KV Selection for Efficient Autoregressive Video Diffusion
图 1 · 摘自论文原文
  • 按帧和注意力头维度动态选择关键历史帧,结合注意力与多样性得分
  • 实现高达1.48倍的端到端加速,且视觉质量与文本对齐更好
  • 适用于多种自回归视频生成场景,无需额外训练

自回归视频扩散模型虽可实现顺序与流式生成,但长时序生成需庞大键值缓存,高效压缩难兼顾质量。现有方法多依赖注意力分数粗略选取历史帧,同一生成块内共享历史选择策略,仅凭注意力评分筛选,头部预算分配或均等或依模式启发式决定,缺乏显式重要性估计。本文发现:同一块内不同帧依赖不同历史帧,同一历史帧随时间距离变化注意力分数不同,屏蔽不同头部导致生成退化不均。为此,提出无需训练的聚焦强制(Focused Forcing)方法,从生成帧与头部两个维度聚焦缓存历史。每帧通过融合注意力与历史帧多样性得分保留最相关且独特的记忆,并为重要头部分配更大预算。在多种自回归生成范式中,该方法实现最高1.48倍的端到端加速,同时提升视觉质量与文本对齐效果。代码将开源。

原文摘要 · Abstract (English)

Recent advances in autoregressive video diffusion have enabled sequential and streaming video generation. However, long-horizon generation requires increasingly large KV caches, making efficient compression without sacrificing quality challenging. Existing methods mostly select historical frames based on attention scores, but their context decisions remain coarse. When multiple frames are generated in the same chunk, these methods often apply a shared history selection to the whole chunk, score historical frames solely by attention, and assign head-wise budgets either uniformly or by attention-pattern heuristics rather than explicit head-importance estimation. We show that frames within the same generated chunk can depend on distinct historical frames, that the same historical frame can receive different attention scores as its relative temporal distance to the current frames changes, and that masking different heads induces unequal generation degradation. Motivated by these findings, we propose \textbf{Focused Forcing}, a training-free KV selection method that focuses cached history along both generated-frame and head dimensions. For each generated frame, Focused Forcing preserves the most relevant and distinctive historical frames by combining attention scores with diversity scores of historical frames, while assigning larger budgets to heads with higher estimated importance. Across multiple autoregressive generation paradigms, Focused Forcing achieves up to $\textbf{1.48}\times$ end-to-end acceleration without training, while \textbf{improving visual quality and text alignment}. \textit{Our code will be released on GitHub.}

视频生成扩散模型缓存优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。