arXiv:2605.20476cs.CV2026-05被引 1

提出锚点树采样法,解决长时视频生成中的质量退化问题。

Goodbye Drift: Anchored Tree Sampling for Long-Horizon Video-to-Video Generation

论文配图:Goodbye Drift: Anchored Tree Sampling for Long-Horizon Video-to-Video Generation
图 1 · 摘自论文原文
  • 用树状结构分步填充关键帧,替代传统逐帧生成。
  • 在五种条件输入下实现40分钟以上稳定生成,显著减少画面漂移。
  • 无需训练,适用于静态相机场景,适合长时视频生成研究者。

长时视频生成面临两大挑战:一是随时间推移的画质退化(漂移),二是连贯性问题,如物体存在性缺失或瞬时内容渲染错误。现有方法多采用自回归蒸馏技术同时应对两者,本文则聚焦于直接抑制漂移,提出无需训练的推理阶段调度器——锚点树采样(Anchored Tree Sampling, ATS)。该方法将传统的左到右逐步生成改为稀疏到密集、锚点约束的树状插值:先生成全时域稀疏锚点,递归细化中间锚点,最后在邻近锚点间合成完整帧。此举将关键路径从K步串行推演缩减为L+1步树形层级处理,使累积漂移转为锚点限定的局部漂移。实验基于静态摄像头设定,在Wan 2.1 + VACE数据集上,针对五种条件模态(补全、外扩、边缘、姿态、深度)对比两种自回归基线,结果表明ATS在整体质量与抗漂移能力上均优于对手。进一步在LTX-2.3上实现≥40分钟稳定生成。最后,文章展望了将ATS扩展至任意长时文本到视频生成,以及动态摄像机和多镜头场景的应用路径。

原文摘要 · Abstract (English)

Long-horizon video generation suffers from two intertwined issues. First, there is drift, where video quality degrades over time. Second, there are continuity issues which manifest as object permanence issues, or improperly rendering transient content (e.g., an object that appears in non-consecutive frames changing color/style). Recent work has focused on autoregressive distillation techniques that attack both problems simultaneously. We instead choose to focus on drift directly and introduce \textbf{Anchored Tree Sampling (ATS)}: a training-free inference-time scheduler that replaces left-to-right rollout with sparse-to-dense, anchor-bounded imputation organized as a tree. A root call produces sparse anchors over the full horizon, recursive refinement generates intermediate anchors, and final leaf spans are synthesized between neighboring anchors. This reduces the critical path from $K$ sequential rollout steps to $L+1$ tree-hierarchical steps and converts horizon-compounding drift into anchor-bounded drift. We focus on V2V generation in the \emph{static-camera} regime, where sparse anchors over the horizon are well approximated by the dense conditioning signal, and the base model can produce them without retraining. We evaluate ATS against two contemporary autoregressive baselines on Wan $2.1$ $+$ VACE, across five conditioning modalities (inpainting, outpainting, edge, pose, depth). We show that ATS outperforms both competitors in overall quality, as well as in drift prevention. We additionally demonstrate stable $\geq 40$-minute generation on LTX-$2.3$ across the same five modalities. We conclude by proposing a path forward to extend ATS to arbitrarily long T2V generation, as well as the dynamic-camera and multi-shot regimes.

视频生成扩散模型长时生成去漂移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。