arXiv:2607.19947cs.CV2026-07

用多智能体系统从剧本自动生成互动式电子剧目

ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Program

论文配图:ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Program
图 1 · 摘自论文原文
  • 构建多智能体框架,分工完成剧本解析与视觉生成
  • 通过全局风格锚点保证多页设计美学一致
  • 支持虚拟角色语音交互,提升剧目沉浸感

电子剧目(ETPs)是表演艺术中关键的宣传媒介,由多页异构视觉内容组成,如舞台海报、演出信息和角色画像。现有文本到图像范式因无法理解长上下文叙事且难以保持跨页面视觉一致性,难以胜任此类复杂设计任务。为此,我们提出ETPDesigner,一个直接从原始戏剧剧本合成高质量ETP的协作式多智能体框架。该框架模拟专业设计流程,协调专用智能体分别完成语义剧本分析、核心海报生成、功能性背景制作以及角色资产分层组合。核心在于全局风格锚机制,从核心海报提取视觉先验,确保所有生成组件严格保持美学统一。此外,我们将ETP升级为沉浸式交互伴侣,集成角色动画、定制语音合成及基于角色设定的大语言模型,实现用户与生成虚拟角色的实时语音对话。为严谨评估该任务,我们构建了领域专用基准ETP-Pro,包含专业剧院海报与高质量角色画像。大量实验表明,本方法在生成语义忠实、美学一致且高度交互的剧目集方面具有显著优势。

原文摘要 · Abstract (English)

Electronic Theater Programs (ETPs) serve as critical promotional media in the performing arts, comprising a multi-page collection of heterogeneous visual assets such as theatrical posters, performance details, and character portraits. However, existing text-to-image paradigms struggle with such complex design tasks due to their inability to comprehend long-context narratives and maintain visual consistency across multiple distinct pages. To address this, we introduce ETPDesigner, a collaborative Multi-Agent framework that directly synthesizes high-quality ETPs from raw dramatic scripts. Emulating a professional design pipeline, our framework orchestrates specialized agents for semantic script analysis, core poster synthesis, functional background generation, and the stratified composition of character assets. Central to ETPDesigner is a global style anchor mechanism that extracts visual priors from the core poster to enforce strict aesthetic uniformity across all generated components. Furthermore, we elevate the ETP from a static publication to an immersive interactive companion. By integrating portrait animation, customized speech synthesis, and persona-grounded Large Language Models (LLMs), our system enables users to engage in real-time, voice-enabled conversations with the generated virtual characters. To rigorously benchmark this task, we construct ETP-Pro, a domain-specific benchmark of professional theater posters and high-quality character portraits. Extensive evaluations demonstrate our method's superiority in producing semantically faithful, aesthetically consistent, and highly interactive program sets.

多智能体电子剧目交互生成风格一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。