用剧本自动生成符合叙事氛围的3D舞台场景
StageDesigner: Artistic Stage Generation for Scenography via Theater Scripts
- 分三步：解析剧本提取主题、生成前景物体、构造协调背景
- 支持不同历史风格，生成场景与剧本氛围一致且空间合理
- 适合舞台设计、影视美术等创意工作者快速构思场景
本文提出StageDesigner，首个结合大语言模型与布局控制扩散模型的艺术化舞台生成框架。针对舞台布景的专业需求，该方法模拟资深艺术家的工作流程，生成沉浸式3D舞台场景。系统分为三个模块：剧本分析模块从输入脚本中提取主题与空间线索；前景生成模块构建并排列关键3D物体；背景生成模块则依据叙事氛围生成和谐背景，并通过管理前后景遮挡关系保持空间一致性。我们还构建了StagePro-V1数据集，包含276个独特舞台场景，涵盖不同历史风格，配有脚本、图像和详细3D布局标注。通过标准与新提出的评估指标，以及大规模用户研究，验证了StageDesigner的有效性。
原文摘要 · Abstract (English)
In this work, we introduce StageDesigner, the first comprehensive framework for artistic stage generation using large language models combined with layout-controlled diffusion models. Given the professional requirements of stage scenography, StageDesigner simulates the workflows of seasoned artists to generate immersive 3D stage scenes. Specifically, our approach is divided into three primary modules: Script Analysis, which extracts thematic and spatial cues from input scripts; Foreground Generation, which constructs and arranges essential 3D objects; and Background Generation, which produces a harmonious background aligned with the narrative atmosphere and maintains spatial coherence by managing occlusions between foreground and background elements. Furthermore, we introduce the StagePro-V1 dataset, a dedicated dataset with 276 unique stage scenes spanning different historical styles and annotated with scripts, images, and detailed 3D layouts, specifically tailored for this task. Finally, evaluations using both standard and newly proposed metrics, along with extensive user studies, demonstrate the effectiveness of StageDesigner. Project can be found at: https://deadsmither5.github.io/2025/01/03/StageDesigner/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。