arXiv:2601.16914cs.CVcs.AI2026-01被引 28

解决长视频生成中反复重复画面的问题,实现12小时不间断生成。

LoL: Longer than Longer, Scaling Video Generation to Hour

  • 用多头位置编码扰动打破注意力同质化,防止内容坍缩。
  • 首次实现无质量衰减的实时流式无限长视频生成。
  • 适合需要稳定持续生成的场景,如虚拟主播或监控视频合成。

长视频生成研究已从双向模型转向自回归模型,但此类方法常因误差累积导致长期连贯性下降。尽管引入了注意力汇点帧以缓解性能衰减,却引发一种称为‘汇点坍缩’的严重缺陷:生成内容反复回退到汇点帧,造成突兀场景切换和循环运动。分析表明,该问题源于旋转位置编码(RoPE)的周期性结构与当前生成模型中多头注意力机制之间的固有冲突。为此,我们提出一种轻量级、无需训练的方法,通过引入多头RoPE抖动,打破头间注意力同质化,有效抑制长时程坍缩。大量实验表明,该方法在保持生成质量的同时显著缓解汇点坍缩。据我们所知,本工作首次实现了实时、流式、无限长度的视频生成且质量衰减极小。作为验证,我们成功生成长达12小时的连续视频,目前为公开演示中最长的流式视频生成结果。

原文摘要 · Abstract (English)

Recent research in long-form video generation has shifted from bidirectional to autoregressive models, yet these methods commonly suffer from error accumulation and a loss of long-term coherence. While attention sink frames have been introduced to mitigate this performance decay, they often induce a critical failure mode we term sink-collapse: the generated content repeatedly reverts to the sink frame, resulting in abrupt scene resets and cyclic motion patterns. Our analysis reveals that sink-collapse originates from an inherent conflict between the periodic structure of Rotary Position Embedding (RoPE) and the multi-head attention mechanisms prevalent in current generative models. To address it, we propose a lightweight, training-free approach that effectively suppresses this behavior by introducing multi-head RoPE jitter that breaks inter-head attention homogenization and mitigates long-horizon collapse. Extensive experiments show that our method successfully alleviates sink-collapse while preserving generation quality. To the best of our knowledge, this work achieves the first demonstration of real-time, streaming, and infinite-length video generation with little quality decay. As an illustration of this robustness, we generate continuous videos up to 12 hours in length, which, to our knowledge, is among the longest publicly demonstrated results in streaming video generation.

视频生成长视频注意力机制生成质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。