用多个智能体协作生成电影预演,25分钟完成一个创意的视觉化。
Mind-of-Director: Multi-modal Agent-Driven Film Previsualization via Collaborative Decision-Making
- 多智能体分工协作,从剧本到镜头全流程自动化生成。
- 每项创意可在约25分钟内生成高质量、语义对齐的预演视频。
- 适合影视团队快速原型设计或人机协同创作。
我们提出Mind-of-Director,一种多模态智能体驱动的电影预演框架,模拟电影制作团队的协作决策过程。给定一个创意想法,该框架通过多个专业智能体在游戏引擎中生成预演序列。系统包含四个协同模块:剧本开发(迭代撰写与优化剧本)、虚拟场景设计(将文本转为语义对齐的3D环境)、角色行为控制(确定角色走位与动作)、相机规划(优化构图、运动与镜头效果)。基于游戏引擎构建的实时视觉编辑系统支持跨场景、行为与相机的交互式检查与时间线同步调整。大量实验与人工评估表明,该框架可在约25分钟内完成每个创意的高质量预演,验证了智能体协作在自动化原型设计与人机协同创作中的有效性。
原文摘要 · Abstract (English)
We present Mind-of-Director, a multi-modal agent-driven framework for film previz that models the collaborative decision-making process of a film production team. Given a creative idea, Mind-of-Director orchestrates multiple specialized agents to produce previz sequences within the game engine. The framework consists of four cooperative modules: Script Development, where agents draft and refine the screenplay iteratively; Virtual Scene Design, which transforms text into semantically aligned 3D environments; Character Behaviour Control, which determines character blocking and motion; and Camera Planning, which optimizes framing, movement, and composition for cinematic camera effects. A real-time visual editing system built in the game engine further enables interactive inspection and synchronized timeline adjustment across scenes, behaviours, and cameras. Extensive experiments and human evaluations show that Mind-of-Director generates high-quality, semantically grounded previz sequences in approximately 25 minutes per idea, demonstrating the effectiveness of agent collaboration for both automated prototyping and human-in-the-loop filmmaking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。