arXiv:2605.31057cs.CVcs.LG2026-05被引 2

无需训练的稀疏注意力机制,让长视频生成更快更稳。

LVSA: Training-Free Sparse Attention for Long Video Diffusion

论文配图:LVSA: Training-Free Sparse Attention for Long Video Diffusion
图 1 · 摘自论文原文
  • 用分块稀疏+旋转全局锚点,避免长时序伪影。
  • 计算量减少3.33倍,支持2倍超长视频生成。
  • 兼容多种芯片,适合部署在边缘设备。

密集自注意力是长视频扩散模型推理中的计算与质量瓶颈:计算成本随序列长度呈平方增长,且超过训练时长后模型输出趋于静态重复,即‘冻结’循环视频。现有方法或需重新训练,或无法在可扩展性下同时满足性能与质量要求。为此,我们提出训练无关的长视频稀疏注意力(LVSA),采用结构化窗口结合旋转全局锚点,消除固定网格偏差导致的长程时间伪影。配合FlashInfer内核,LVSA在Wan 2.1 1.3B上实现6倍时长下3.17倍计算缩减,Wan 2.1 14B上达2.98倍,HunyuanVideo 1.5在1.5倍时长下达3.33倍;并首次实现单卡生成HunyuanVideo 1.5的2倍时长视频。相比RIFLEx和UltraViCo,速度提升最高达2.41倍与3.27倍。在NPU上应用也取得最高2.71倍加速。为公平评估质量,我们引入VQeval,有效识别循环视频问题——而主流评测如VBench-Long反而奖励此类错误。LVSA在训练时长内保持质量中立,在延长时长下表现更优。

原文摘要 · Abstract (English)

Dense self-attention is the compute and quality bottleneck of long-video diffusion inference: cost grows quadratically with the sequence length, and beyond the training horizon the model converges to near-static output, that is, "frozen" repetitive video. State of the art approaches are either too costly, e.g., they require retraining, or fail to satisfy both performance and quality objectives in a scalable manner. To this end, we introduce Long Video Sparse Attention (LVSA), a training-free model-agnostic block-sparse attention for video diffusion transformers that combines a structured window pattern with rotating global anchors, thus removing the fixed-grid bias which causes long-range temporal artifacts. LVSA, combined with a FlashInfer kernel, reduces compute up to 3.17x on Wan 2.1 1.3B at a 6x horizon, 2.98x on Wan 2.1 14B at a 6x horizon, and 3.33x on HunyuanVideo 1.5 at a 1.5x horizon, compared to dense attention. Beyond reducing compute, LVSA enables HunyuanVideo 1.5 generation at a 2x horizon, which is otherwise out-of-memory on a single GPU. Moreover, LVSA provides speedups up to 2.41x compared to RIFLEx and 3.27x compared to UltraViCo on Wan 2.1 1.3B. To demonstrate applicability across diverse platforms, we apply LVSA on NPUs and achieve speedups up to 2.71x on Wan 2.2 A14B and 3.24x on Wan 2.1 1.3B compared to dense attention. To evaluate quality in a fair way, we introduce VQeval, a tool properly scoring loopy video failures, which instead are rewarded in state of the art evaluators like VBench-Long. LVSA is quality-neutral for generation at training horizon length and quality-positive at extended lengths.

视频生成稀疏注意力长序列高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。