arXiv:2603.13405cs.CVeess.IV2026-03被引 10

解决交互式长视频生成中画质下降与运动不连贯问题

Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion

论文配图:Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion
图 1 · 摘自论文原文
  • 用锚点缓存机制在提示切换时保留语义与动态信息
  • 引入三区域位置编码,稳定长序列生成中的运动一致性
  • 适合需要实时交互的视频生成场景,如直播特效

交互式长视频生成需支持提示切换以引入新主体或事件,同时保持感知保真度和长时间内的运动连贯性。现有压缩型流式视频扩散模型通过滚动键值缓存实现长程生成,并在每次提示切换时重缓存以支持交互。然而,当前方法仍存在渐进式质量退化和运动动态减弱的问题。我们识别出两个特定于交互式流式生成的失效模式:(i) 每次提示切换时,现有缓存维护无法同时保留基于键值的语义上下文和近期潜在线索,导致边界条件弱化,感知质量下降;(ii) 在蒸馏过程中,无界时间索引引发位置分布偏移,脱离预训练骨干模型的有界RoPE范式,削弱了预训练运动先验并降低长时运动保持能力。为此,我们提出 extbf{Anchor Forcing},一种以缓存为中心的框架,包含两项设计:首先,锚点引导的重缓存机制将键值状态存储于锚点缓存中,并在每次提示切换时从这些锚点热启动重缓存,减少切换后证据损失,稳定感知质量;其次,采用具有区域特异性参考原点的三区域RoPE,结合RoPE重新对齐蒸馏,弥合无界流式索引与预训练RoPE范式的差异,更好保留运动先验。在长视频上的实验表明,该方法在交互设置下优于先前流式基线,在感知质量和运动指标上均有提升。

原文摘要 · Abstract (English)

Interactive long video generation requires prompt switching to introduce new subjects or events, while maintaining perceptual fidelity and coherent motion over extended horizons. Recent distilled streaming video diffusion models reuse a rolling KV cache for long-range generation, enabling prompt-switch interaction through re-cache at each switch. However, existing streaming methods still exhibit progressive quality degradation and weakened motion dynamics. We identify two failure modes specific to interactive streaming generation: (i) at each prompt switch, current cache maintenance cannot simultaneously retain KV-based semantic context and recent latent cues, resulting in weak boundary conditioning and reduced perceptual quality; and (ii) during distillation, unbounded time indexing induces a positional distribution shift from the pretrained backbone's bounded RoPE regime, weakening pretrained motion priors and long-horizon motion retention. To address these issues, we propose \textbf{Anchor Forcing}, a cache-centric framework with two designs. First, an anchor-guided re-cache mechanism stores KV states in anchor caches and warm-starts re-cache from these anchors at each prompt switch, reducing post-switch evidence loss and stabilizing perceptual quality. Second, a tri-region RoPE with region-specific reference origins, together with RoPE re-alignment distillation, reconciles unbounded streaming indices with the pretrained RoPE regime to better retain motion priors. Experiments on long videos show that our method improves perceptual quality and motion metrics over prior streaming baselines in interactive settings. Project page: https://github.com/vivoCameraResearch/Anchor-Forcing

视频生成扩散模型长视频交互生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。