arXiv:2605.26525cs.CVcs.AI2026-05被引 3

让视频模型长镜头连贯生成,保持剧情和画面一致性。

ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation

  • 分层递归分配上下文,拆解长视频生成为可管理子任务。
  • 在3~5分钟视频生成中,一致性和评分提升28%~43%。
  • 适合需要连续叙事的影视生成、动画制作等场景。

分钟级电影化视频生成是生成式视频模型的核心挑战。现有方法仅解决部分问题:单次外推保留锚点但缺乏电影结构;多段叙事虽有结构却自由虚构视觉状态,而非延续观测内容。本文定义了多段视频外推(MSVE)任务,即在保持锚点状态和推进叙事意图的前提下,将观察到的帧或片段扩展为具有电影结构的连续镜头序列。该任务受限于短视频模型的有限生成预算。我们识别出三个耦合瓶颈:(1) 全局规划过度指定未支持的细节;(2) 镜头级提示在携带完整故事时稀释关键状态;(3) 时间链式生成导致身份、场景、物体和动作状态衰减。实验表明,长视频失败不仅是上下文长度限制,更是上下文分配失效。为此提出推理时框架ReCA,通过递归分解将MSVE转为上下文受限子问题,在叶节点调用冻结生成器,并跨时间传播结构化状态更新。为评估该设定,提出MSVE-Bench与NB-Q,一种面向3~5分钟视频生成的源基协议,专为此前未被短片段基准覆盖的场景设计。相比先前方法,ReCA在平均归一化得分上优于最强控制器8%~16%,多段一致性指标提升28%~43%。

原文摘要 · Abstract (English)

Minute-scale cinematic video generation is a central challenge for generative video models. Existing paradigms address only fragments of this challenge: single-shot extrapolation preserves an anchor but lacks cinematic structure, while multi-shot storytelling imposes structure yet remains free to invent its visual states rather than continue an observed one. We define Multi-Shot Video Extrapolation (MSVE), a task that extends an observed frame or clip into a sequence of cinematically structured shots while preserving anchor state and advancing narrative intent. This setting operates under the finite per-call generation budget of short-video models. We identify three coupled bottlenecks: (1) global planners over-specify unsupported details from full screenplays; (2) shot-level prompts dilute task-relevant state when carrying the complete story; and (3) temporal chaining turns generated frames into a lossy memory in which identity, scene, object, and action state decay. MSVE reveals that long-video failure is not merely a limitation of context length, but a failure of context allocation. We propose Recursive Context Allocation (ReCA), an inference-time framework that allocates context hierarchically across planning and generation. ReCA recursively decomposes MSVE into context-bounded subproblems, invokes frozen generators at leaf nodes, and propagates structured state updates across time. To evaluate this setting, we further propose MSVE-Bench and NB-Q, a source-grounded protocol with prompts purpose-built for 3 to 5 minute long-video generation, a regime not addressed by existing short-clip benchmarks. Compared to previous methods, ReCA improves average normalized score by 8 to 16 percent over the strongest competing controller and improves multi-shot consistency metrics by 28 to 43 percent. View the project page at https://reca.vmv.re.

视频生成长视频叙事一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。