arXiv:2603.21366cs.CV2026-03中稿 · BMVC 2026被引 17

提出分角色记忆机制,让长视频生成更稳更连贯

Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation

  • 将历史帧分为三类:全局锚点、短期连续、中程结构,动态选择避免冗余
  • 在VBench-Long上提升运动动态与整体质量,优于现有自回归基线
  • 无需训练,适合追求长视频生成稳定性的研究者和开发者

自回归视频扩散模型为长视频生成提供了有前景的范式,突破了双向模型的时间限制。现有基于强迫训练的策略虽能缓解暴露偏差,但分钟级生成仍受渐进性时间退化和运动演化受限影响。本文研究长时序自回归推理中时间键值记忆的作用,发现单纯保留更多历史帧并不能持续提升生成质量;记忆的数量与时间位置均显著影响运动动态。这表明时间记忆应被视为结构化上下文,而非同质的时间缓冲区。为此,我们提出无需训练的松弛强制(Relax Forcing)机制,将时间上下文分解为三部分:提供全局稳定的锚帧、保持短期连续性的尾帧,以及通过松弛准则动态选择的中程历史帧。该机制促进与全局锚点对齐,抑制与近期内容冗余。角色感知的稀疏记忆设计在减少误差累积的同时保留运动演化并降低注意力开销。在VBench-Long上的实验表明,该方法显著提升长视频生成效果,实现更强的运动动态与更高综合评分,验证了结构化时间记忆在可扩展长视频生成中的有效性。

原文摘要 · Abstract (English)

Autoregressive video diffusion has recently emerged as a promising paradigm for long-video generation, enabling causal synthesis beyond the temporal limits of bidirectional models. Existing forcing-based training strategies reduce exposure bias by conditioning models on their own predictions during rollout, yet minute-scale generation remains challenging due to progressive temporal degradation and constrained motion evolution. In this work, we study the role of temporal KV memory during long-horizon autoregressive inference. Our analysis shows that simply retaining more historical frames does not consistently improve generation quality; instead, both the quantity and temporal placement of memory strongly affect motion dynamics. These findings suggest that temporal memory should be treated as structured context rather than a homogeneous chronological buffer. Motivated by this observation, we introduce Relax Forcing, a training-free memory mechanism for autoregressive video diffusion. Relax Forcing decomposes temporal context into three functional components: Sink frames that provide global stability, Tail frames that preserve short-term continuity, and dynamically selected History frames that supply mid-range motion structure. History frames are selected using a relaxation-based criterion that encourages alignment with global anchors while suppressing redundancy with recent context. This role-aware sparse memory design mitigates error accumulation during long-horizon rollout while preserving motion evolution and reducing attention overhead. Experiments on VBench-Long show that Relax Forcing improves long-video generation, achieving stronger motion dynamics and higher overall scores than existing autoregressive baselines. These results indicate that structured temporal memory is an effective and complementary direction for scalable long-video generation.

长视频生成自回归模型记忆机制扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。