arXiv:2506.10540cs.MAcs.CV2025-06SIGGRAPH被引 15

用多智能体和搜索策略生成连贯动画,让AI讲故事更自然

AniMaker: Multi-Agent Animated Storytelling with MCTS-Driven Clip Generation

  • 分角色智能体协作,先构思剧本再生成视频片段
  • 通过搜索优化生成高质量片段,避免低质片段拖累整体
  • 专为多镜头动画设计评估框架,能判断故事连贯性

尽管视频生成模型进展迅速,但生成跨越多个场景和角色的连贯叙事视频仍具挑战。现有方法通常将预生成的关键帧机械转换为固定长度片段,导致叙事断裂与节奏失调。此外,视频生成模型固有的不稳定性使得单个低质量片段即可显著破坏整体动画的逻辑连贯性与视觉连续性。为此,我们提出 AniMaker,一个基于多智能体的框架,实现高效多候选片段生成与叙事感知的片段选择,仅需文本输入即可生成全局一致、故事连贯的动画。该框架包含导演智能体(生成分镜)、摄影智能体(生成视频片段)、评审智能体(评估质量)和后期智能体(剪辑与配音)。核心技术创新包括:摄影智能体中的 MCTS-Gen,一种受蒙特卡洛树搜索启发的高效策略,可智能探索候选空间并优化资源使用;以及评审智能体中的 AniEval,首个专为多镜头动画设计的评估框架,通过结合前后片段上下文,评估故事一致性、动作完整性与动画特征。实验表明,AniMaker 在 VBench 及自研 AniEval 框架下均达到更优质量,同时显著提升多候选生成效率,使 AI 生成叙事动画更接近生产标准。

原文摘要 · Abstract (English)

Despite rapid advancements in video generation models, generating coherent storytelling videos that span multiple scenes and characters remains challenging. Current methods often rigidly convert pre-generated keyframes into fixed-length clips, resulting in disjointed narratives and pacing issues. Furthermore, the inherent instability of video generation models means that even a single low-quality clip can significantly degrade the entire output animation's logical coherence and visual continuity. To overcome these obstacles, we introduce AniMaker, a multi-agent framework enabling efficient multi-candidate clip generation and storytelling-aware clip selection, thus creating globally consistent and story-coherent animation solely from text input. The framework is structured around specialized agents, including the Director Agent for storyboard generation, the Photography Agent for video clip generation, the Reviewer Agent for evaluation, and the Post-Production Agent for editing and voiceover. Central to AniMaker's approach are two key technical components: MCTS-Gen in Photography Agent, an efficient Monte Carlo Tree Search (MCTS)-inspired strategy that intelligently navigates the candidate space to generate high-potential clips while optimizing resource usage; and AniEval in Reviewer Agent, the first framework specifically designed for multi-shot animation evaluation, which assesses critical aspects such as story-level consistency, action completion, and animation-specific features by considering each clip in the context of its preceding and succeeding clips. Experiments demonstrate that AniMaker achieves superior quality as measured by popular metrics including VBench and our proposed AniEval framework, while significantly improving the efficiency of multi-candidate generation, pushing AI-generated storytelling animation closer to production standards.

动画生成多智能体故事连贯性评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。