用智能代理框架把对话直接变成长镜头电影，解决生成连贯剧情的难题。
The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation
- 引入双代理框架：脚本代理将对话转为可执行分镜脚本
- 在多场景连续生成下，脚本忠实度提升37%，时间连贯性增强
- 适合影视自动化、创意编剧或视频生成研究者使用
近期视频生成模型已能从简单文本提示生成高质量视觉内容，但在从高层次概念（如对话）生成长时序、连贯叙事方面仍存在“语义鸿沟”。为此，我们提出一种端到端的智能体框架，用于对话到电影视频的生成。核心是ScripterAgent，该模型经训练可将粗略对话转化为细粒度、可执行的电影剧本。为此，我们构建了ScriptBench——一个大规模多模态基准数据集，通过专家引导流程进行标注。生成的剧本由DirectorAgent调度，利用跨场景连续生成策略，协调先进视频模型以保证长时序一致性。综合评估中，采用AI驱动的CriticAgent与新提出的视觉-脚本对齐（VSA）指标显示，本框架显著提升了所有测试视频模型的脚本忠实度与时间保真度。进一步分析揭示当前主流模型在视觉奇观与脚本严格遵循间存在关键权衡，为自动电影制作提供重要启示。
原文摘要 · Abstract (English)
Recent advances in video generation have produced models capable of synthesizing stunning visual content from simple text prompts. However, these models struggle to generate long-form, coherent narratives from high-level concepts like dialogue, revealing a ``semantic gap'' between a creative idea and its cinematic execution. To bridge this gap, we introduce a novel, end-to-end agentic framework for dialogue-to-cinematic-video generation. Central to our framework is ScripterAgent, a model trained to translate coarse dialogue into a fine-grained, executable cinematic script. To enable this, we construct ScriptBench, a new large-scale benchmark with rich multimodal context, annotated via an expert-guided pipeline. The generated script then guides DirectorAgent, which orchestrates state-of-the-art video models using a cross-scene continuous generation strategy to ensure long-horizon coherence. Our comprehensive evaluation, featuring an AI-powered CriticAgent and a new Visual-Script Alignment (VSA) metric, shows our framework significantly improves script faithfulness and temporal fidelity across all tested video models. Furthermore, our analysis uncovers a crucial trade-off in current SOTA models between visual spectacle and strict script adherence, providing valuable insights for the future of automated filmmaking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。