arXiv:2512.16371cs.CV2025-12被引 1

分步生成视频:先构图再动效,提升复杂场景准确率

Anchored Video Generation: Decoupling Scene Construction and Temporal Synthesis in Text-to-Video Diffusion Models

  • 用大模型重写提示词,只描述初始画面,消除时间歧义
  • 先生成高质量静态图作锚点,再专注动画合成,效果更准
  • 减少70%采样步骤仍保持性能,适合追求效率的开发者

当前最先进的文本到视频扩散模型虽能生成视觉惊艳的结果,但仍常在构建复杂场景或遵循逻辑时序指令时失败。本文认为,许多错误(如运动异常)源于模型无法构建语义正确或逻辑一致的初始帧。为此提出锚定视频生成(AVG),将文本到视频生成拆分为三个专业化阶段:(1) 推理阶段,使用大语言模型(LLM)重写视频提示,仅描述初始场景,消除时间模糊性;(2) 构成阶段,通过文本到图像(T2I)模型根据新提示生成高质量、构图正确的锚定帧;(3) 时序合成阶段,微调后的视频模型基于该锚定帧,集中全部能力进行场景动画与指令跟随。该方法在T2V CompBench基准上达到新SOTA,显著提升所有测试模型在VBench2的表现。此外,可视化锚定使采样步数减少70%而性能不变。AVG为更高效、鲁棒且可控的视频生成提供了简单实用的路径。

原文摘要 · Abstract (English)

State-of-the-art Text-to-Video (T2V) diffusion models can generate visually impressive results, yet they still frequently fail to compose complex scenes or follow logical temporal instructions. In this paper, we argue that many errors, including apparent motion failures, originate from the model's inability to construct a semantically correct or logically consistent initial frame. We introduce Anchored Video Generation (AVG), a modular pipeline that decouples these tasks by decomposing the Text-to-Video generation into three specialized stages: (1) Reasoning, where a Large Language Model (LLM) rewrites the video prompt to describe only the initial scene, resolving temporal ambiguities; (2) Composition, where a Text-to-Image (T2I) model synthesizes a high-quality, compositionally-correct anchor frame from this new prompt; and (3) Temporal Synthesis, where a video model, finetuned to understand this anchor, focuses its entire capacity on animating the scene and following the prompt. Our approach sets a new state-of-the-art on the T2V CompBench benchmark and significantly improves all tested models on VBench2. Furthermore, we show that visual anchoring allows us to cut the number of sampling steps by 70% without any loss in performance. AVG offers a simple yet practical path toward more efficient, robust, and controllable video synthesis.

视频生成扩散模型提示工程多阶段

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。