arXiv:2608.29814cs.AI2026-08

用多个智能体协作生成视频,自动管理创作流程。

FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production

论文配图:FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production
图 1 · 摘自论文原文
  • 设计动态任务栈与工作区,由主控智能体调度执行
  • 比大模型规划更准,能恢复故障并适配新工具
  • 适合需要灵活创作的视频生成项目

现代视频生成器擅长合成单个片段,但完整视频制作需协调脚本、分镜、生成、剪辑等多步依赖任务,还需持续管理资产和动态调度中间状态。现有系统多为固定流水线,难以适应多样化输入与变化流程;通用大语言模型在长周期编排和跨模态资源调度上仍不可靠。我们提出 FRAMEWORKERS,一种以任务为中心、基于工作区的多智能体框架,用于开放式的视频生产。中央导演将视频创作视为动态任务管理,持续编辑任务栈以决定下一步执行的任务及调用的子智能体。助手作为执行层,将选定任务锚定在共享工作区,获取所需资产与上下文,调用指定子智能体,并持久化产出成果。执行能力通过模块化子智能体及其注册描述符暴露,支持新增子智能体而无需重设计编排流程。为提升调度可靠性,我们采用监督微调(SFT)结合组相对策略优化(GRPO)对导演进行微调,实现基于描述符的条件化任务路由。实验表明,FRAMEWORKERS 在路由准确率上优于强基线大模型,可可靠恢复运行时故障,无需重训即可泛化至未见子智能体,且端到端视频质量更高、任务覆盖范围更广,显著超越固定流水线、单智能体系统及先前多智能体方法。

原文摘要 · Abstract (English)

Modern video generators excel at synthesizing individual clips, but complete video production requires coordinating a long sequence of interdependent creative steps, including scripting, storyboarding, generation, and editing. It further demands persistent asset management and dynamic task orchestration as intermediate outputs, dependencies, and execution states evolve over time. Existing automated systems typically rely on rigid pipelines that are difficult to adapt to diverse inputs and changing workflows, while general-purpose large language models (LLMs) remain unreliable for long-horizon orchestration and multimodal asset routing. We introduce FRAMEWORKERS, a task-centric and workspace-grounded multi-agent framework for open-ended video production. A central Director formulates video creation as dynamic task management, continuously editing a Task Stack to determine which subtask to execute next and which sub-agent to invoke. An Assistant serves as the execution layer, grounding each selected task in a shared Workspace, retrieving the required assets and context, invoking the assigned sub-agent, and persisting the resulting artifacts. Execution capabilities are exposed through modular sub-agents with registered descriptors, allowing new sub-agents to be integrated without redesigning the orchestration workflow. To improve orchestration reliability, we fine-tune the Director via supervised fine-tuning (SFT) followed by Group Relative Policy Optimization (GRPO) for descriptor-conditioned task routing. Experiments show that FRAMEWORKERS outperforms strong LLM planners in routing accuracy, recovers reliably from runtime failures, generalizes to unseen sub-agents without retraining, and achieves higher end-to-end video quality and broader task coverage than fixed pipelines, single-agent systems, and prior multi-agent approaches.

视频生成多智能体自动化创作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。