用多个AI角色自动编剧本拍电影,省去人工规划。
Automated Movie Generation via Multi-Agent CoT Planning
- 用多个AI角色模拟导演、编剧等,自动生成分镜和拍摄方案。
- 生成的电影剧情连贯,角色一致,字幕与音频同步稳定。
- 适合影视自动化、AI创作领域研究者和开发者参考。
现有长视频生成框架缺乏自动化规划,需人工输入剧情、场景、镜头和角色互动,导致成本高、效率低。为此,我们提出MovieAgent,一种基于多智能体思维链(CoT)规划的自动电影生成方法。MovieAgent具备两大优势:1)首次探索并定义了自动电影/长视频生成范式;给定剧本和角色库,可生成多场景、多镜头的长视频,保持剧情连贯性、角色一致性、字幕与音频同步稳定。2)引入分层式CoT推理流程,自动规划场景、摄像设置与镜头语言,显著降低人工参与。通过多个大模型智能体分别模拟导演、编剧、分镜师和场地经理,实现全流程自动化。实验表明,MovieAgent在剧本忠实度、角色一致性及叙事连贯性上达到新最佳性能。该分层框架为全自动电影生成迈出关键一步,提供了新思路。代码与项目主页见:https://github.com/showlab/MovieAgent 及 https://weijiawu.github.io/MovieAgent。
原文摘要 · Abstract (English)
Existing long-form video generation frameworks lack automated planning, requiring manual input for storylines, scenes, cinematography, and character interactions, resulting in high costs and inefficiencies. To address these challenges, we present MovieAgent, an automated movie generation via multi-agent Chain of Thought (CoT) planning. MovieAgent offers two key advantages: 1) We firstly explore and define the paradigm of automated movie/long-video generation. Given a script and character bank, our MovieAgent can generates multi-scene, multi-shot long-form videos with a coherent narrative, while ensuring character consistency, synchronized subtitles, and stable audio throughout the film. 2) MovieAgent introduces a hierarchical CoT-based reasoning process to automatically structure scenes, camera settings, and cinematography, significantly reducing human effort. By employing multiple LLM agents to simulate the roles of a director, screenwriter, storyboard artist, and location manager, MovieAgent streamlines the production pipeline. Experiments demonstrate that MovieAgent achieves new state-of-the-art results in script faithfulness, character consistency, and narrative coherence. Our hierarchical framework takes a step forward and provides new insights into fully automated movie generation. The code and project website are available at: https://github.com/showlab/MovieAgent and https://weijiawu.github.io/MovieAgent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。