arXiv:2605.30349cs.CV2026-05被引 1

让视频生成动态更自然,自适应锚点替代固定首帧

AdaState: Self-Evolving Anchors for Streaming Video Generation

论文配图:AdaState: Self-Evolving Anchors for Streaming Video Generation
图 1 · 摘自论文原文
  • 用可迭代更新的隐状态替代固定首帧作为参考
  • 视频运动和场景变化显著增强,动态表现提升明显
  • 适合需要流畅连续动作的视频生成任务

自回归视频扩散模型通过逐帧生成并依赖前序内容进行条件控制。这类模型结构上锚定于第一帧:其键值对表示在注意力缓存中占据特权位置,作为整个生成过程的主要场景参考。由于该锚点是缓存中最干净、无误差的位置,会吸引过多关注,抑制视频动态,使场景构图锁定在初始视角,即使场景本应自然演变。结果导致视频时间维度浅显,运动、摄像机移动和场景推进被削弱,以换取静态一致性。为解决此问题,我们引入自适应状态(adaptive state),一个模型在每帧生成时去噪但不渲染的隐藏潜在变量。模型不再依赖冻结的第一帧,而是通过同时关注前一状态和当前内容,在每一步自主生成演化中的场景锚点。与标准视频生成不同,我们的方法将时间视为相对而非绝对:每个生成步骤具有相同的定位结构,状态转移在每一帧中一致。这些特性使生成过程具备递归性,去噪充当转移函数,键值缓存作为载体,无需外部模块。实验表明,自适应状态显著提升视频动态性,实现更丰富的运动与自然的场景推进。

原文摘要 · Abstract (English)

Autoregressive video diffusion models generate streaming video by producing frames sequentially, conditioning each chunk on previously generated content. These models are structurally anchored to the first frame: its key-value representation occupies a privileged position in the attention cache and serves as the primary scene reference throughout generation. As the cleanest and most error-free position in the cache, this anchor draws disproportionate attention, suppressing video dynamics, and locking scene composition to the initial viewpoint even as the scene naturally evolves. The result is a temporally shallow video in which motion, camera movement, and scene progression are dampened in favor of static consistency. To address this, we replace the static anchor with an adaptive state, a hidden latent that the model denoises alongside content at every chunk but never renders. Rather than referencing a frozen first frame, the model generates its own scene anchor at each step by attending to both the previous state and the current content, producing a reference that evolves with the generated content. Unlike standard video generation, which encodes an absolute notion of time, our formulation treats time as relative: every generation step sees the same positional structure regardless of how far generation has progressed, and the state transition is identical at every chunk. Together, these properties introduce a recurrence into the generation process, where denoising serves as the transition function, and the KV cache serves as the carrier, requiring no external module. Experiments demonstrate that the adaptive state substantially improves video dynamics, enabling richer motion and natural scene progression within generated videos.

视频生成扩散模型动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。