arXiv:2506.18899cs.CV2025-06被引 29

用真实电影数据训练AI,自动生成专业级镜头语言和节奏的影片。

FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generation

  • 从44万部电影中学习镜头语言,生成多样专业画面。
  • 通过模拟观众反馈优化剪辑节奏,提升叙事吸引力。
  • 适合影视创作者快速产出可编辑的高质量视频内容。

基于生成式AI的内容创作在影视制作中展现出潜力,但现有系统难以实现专业级的电影语言,导致画面模板化、节奏单调。为此,我们提出FilMaster,一个端到端的AI电影生成系统,融合真实电影数据与专业后期流程,生成可编辑的行业标准输出。系统包含两个阶段:参考引导生成阶段,利用包含44万部电影片段的语料库,通过多镜头协同的RAG镜头语言设计模块,指导AI生成专业镜头语言;生成后处理阶段,通过观众中心的电影节奏控制模块,模拟粗剪与精剪流程,结合视听元素实现沉浸式叙事节奏。系统依托(M)LLM与视频生成模型,同时构建FilmEval评估基准。实验表明,FilMaster在镜头语言与节奏控制方面均显著优于现有方法,推动生成式AI向专业影视制作迈进。

原文摘要 · Abstract (English)

AI-driven content creation has shown potential in film production. However, existing film generation systems struggle to implement cinematic principles and thus fail to generate professional-quality films, particularly lacking diverse camera language and cinematic rhythm. This results in templated visuals and unengaging narratives. To address this, we introduce FilMaster, an end-to-end AI system that integrates real-world cinematic principles for professional-grade film generation, yielding editable, industry-standard outputs. FilMaster is built on two key principles: (1) learning cinematography from extensive real-world film data and (2) emulating professional, audience-centric post-production workflows. Inspired by these principles, FilMaster incorporates two stages: a Reference-Guided Generation Stage which transforms user input to video clips, and a Generative Post-Production Stage which transforms raw footage into audiovisual outputs by orchestrating visual and auditory elements for cinematic rhythm. Our generation stage highlights a Multi-shot Synergized RAG Camera Language Design module to guide the AI in generating professional camera language by retrieving reference clips from a vast corpus of 440,000 film clips. Our post-production stage emulates professional workflows by designing an Audience-Centric Cinematic Rhythm Control module, including Rough Cut and Fine Cut processes informed by simulated audience feedback, for effective integration of audiovisual elements to achieve engaging content. The system is empowered by generative AI models like (M)LLMs and video generation models. Furthermore, we introduce FilmEval, a comprehensive benchmark for evaluating AI-generated films. Extensive experiments show FilMaster's superior performance in camera language design and cinematic rhythm control, advancing generative AI in professional filmmaking.

电影生成镜头语言节奏控制AI影视

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。