arXiv:2509.26555cs.CV2025-09NeurIPS被引 5

为专业视频生成建立可量化的评估体系,填补行业需求空白。

Stable Cinemetrics : Structured Taxonomy and Evaluation for Professional Video Generation

  • 构建四类电影制作控制的分层分类体系,涵盖76个精细控制节点。
  • 通过80+专业人士标注2万+视频,发现顶尖模型在事件与镜头控制上仍存明显差距。
  • 提出自动评估模型,可高效替代人工,适合影视生成研究者使用。

近期视频生成技术已能根据用户提示生成高保真视频,但现有模型与评测体系未能涵盖专业视频制作的复杂性与要求。为此,我们提出Stable Cinemetrics,一个结构化评估框架,将电影制作控制分解为四个解耦的层级分类:设置(Setup)、事件(Event)、灯光(Lighting)和镜头(Camera)。这些分类共同定义了76个基于行业实践的细粒度控制节点。基于此,我们构建了与专业应用场景对齐的提示基准,并开发自动化流程实现提示分类与问题生成,支持对每个控制维度的独立评估。我们开展了大规模人工评测,覆盖10余种模型与2万+视频,由80余名电影专业人士参与标注。粗粒度与细粒度分析显示,即使当前最强模型在事件与镜头相关控制上仍存在显著缺陷。为实现可扩展评估,我们训练了一个与专家标注对齐的视觉-语言自动评估模型,其性能优于现有零样本基线。SCINE是首个将专业视频生成置于生成模型语境中的方法,引入以电影控件为中心的分类体系,并配套结构化评估管道与详尽分析,为未来研究提供指引。

原文摘要 · Abstract (English)

Recent advances in video generation have enabled high-fidelity video synthesis from user provided prompts. However, existing models and benchmarks fail to capture the complexity and requirements of professional video generation. Towards that goal, we introduce Stable Cinemetrics, a structured evaluation framework that formalizes filmmaking controls into four disentangled, hierarchical taxonomies: Setup, Event, Lighting, and Camera. Together, these taxonomies define 76 fine-grained control nodes grounded in industry practices. Using these taxonomies, we construct a benchmark of prompts aligned with professional use cases and develop an automated pipeline for prompt categorization and question generation, enabling independent evaluation of each control dimension. We conduct a large-scale human study spanning 10+ models and 20K videos, annotated by a pool of 80+ film professionals. Our analysis, both coarse and fine-grained reveal that even the strongest current models exhibit significant gaps, particularly in Events and Camera-related controls. To enable scalable evaluation, we train an automatic evaluator, a vision-language model aligned with expert annotations that outperforms existing zero-shot baselines. SCINE is the first approach to situate professional video generation within the landscape of video generative models, introducing taxonomies centered around cinematic controls and supporting them with structured evaluation pipelines and detailed analyses to guide future research.

视频生成评估框架电影制作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。