GenAI正重塑电影创作，从角色生成到视觉风格的全流程革新。
Generative AI for Film Creation: A Survey of Recent Advances
- 整合扩散模型、神经辐射场等技术，实现文本到图像/视频生成
- 解决角色一致性、风格连贯性与动作连续性的核心挑战
- 适合影视创作者与研究者了解AI赋能下的艺术表达新可能
生成式人工智能（GenAI）正在改变电影制作，为艺术家提供文本到图像、图像到视频的扩散模型、神经辐射场、虚拟角色生成和3D合成等工具。本文分析了这些技术在近期AI驱动电影中的应用，探讨其在角色创造、美学风格和叙事表达中的作用。研究聚焦于保持角色一致性、实现风格统一及运动连贯性的关键策略，并揭示3D生成兴起与真实画面与AI元素融合的趋势。此外，GenAI拓展了艺术表达边界，可生成难以实拍的画面、梦幻般的扩散变形效果、抽象视觉及超现实物体。我们还收集了艺术家对一致性和可控性、细粒度编辑及运动优化等方面挑战的反馈。本研究为理解AI与电影制作的交叉发展提供了洞见，为研究人员与创作者提供前行路线图。
原文摘要 · Abstract (English)
Generative AI (GenAI) is transforming filmmaking, equipping artists with tools like text-to-image and image-to-video diffusion, neural radiance fields, avatar generation, and 3D synthesis. This paper examines the adoption of these technologies in filmmaking, analyzing workflows from recent AI-driven films to understand how GenAI contributes to character creation, aesthetic styling, and narration. We explore key strategies for maintaining character consistency, achieving stylistic coherence, and ensuring motion continuity. Additionally, we highlight emerging trends such as the growing use of 3D generation and the integration of real footage with AI-generated elements. Beyond technical advancements, we examine how GenAI is enabling new artistic expressions, from generating hard-to-shoot footage to dreamlike diffusion-based morphing effects, abstract visuals, and unworldly objects. We also gather artists' feedback on challenges and desired improvements, including consistency, controllability, fine-grained editing, and motion refinement. Our study provides insights into the evolving intersection of AI and filmmaking, offering a roadmap for researchers and artists navigating this rapidly expanding field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。