提出可自动验证长视频生成质量的新方法,解决人工审核难、评估慢的问题。
MSG Score: Automated Video Verification for Reliable Multi-Scene Generation
- 用分层注意力机制设计新评分标准,评估视频叙事与视觉一致性。
- 在多个数据集上实现95%以上的高质量视频识别准确率。
- 适合需要快速生成与筛选长视频的AI创作平台或研究者使用。
尽管文本到视频的扩散模型已取得显著进展,但生成连贯的长视频内容仍不可靠,主要源于随机采样带来的伪影。这导致必须生成多个候选视频,而验证过程成为严重瓶颈:人工审核无法扩展,现有自动化指标又缺乏适应性与实时性。另一个关键挑战是评估质量与运行效率之间的权衡——最能模拟人类判断的指标往往过于耗时,无法支持迭代生成。为此,我们提出一种可扩展的长视频自动化验证框架。首先引入MSG(Multi-Scene Generation)评分,一种基于分层注意力的度量方法,可自适应评估叙事与视觉一致性。该评分作为核心验证器集成于CGS(Candidate Generation and Selection)框架中,自动识别并筛选高质量输出。此外,我们提出隐式洞察蒸馏(IID),将复杂评估指标的洞察压缩为轻量级学生模型,有效平衡评估可靠性与推理速度。本方法首次提供可靠的、可扩展的长视频生成解决方案。
原文摘要 · Abstract (English)
While text-to-video diffusion models have advanced significantly, creating coherent long-form content remains unreliable due to stochastic sampling artifacts. This necessitates generating multiple candidates, yet verifying them creates a severe bottleneck; manual review is unscalable, and existing automated metrics lack the adaptability and speed required for runtime monitoring. Another critical issue is the trade-off between evaluation quality and run-time performance: metrics that best capture human-like judgment are often too slow to support iterative generation. These challenges, originating from the lack of an effective evaluation, motivate our work toward a novel solution. To address this, we propose a scalable automated verification framework for long-form video. First, we introduce the MSG(Multi-Scene Generation) score, a hierarchical attention-based metric that adaptively evaluates narrative and visual consistency. This serves as the core verifier within our CGS (Candidate Generation and Selection) framework, which automatically identifies and filters high-quality outputs. Furthermore, we introduce Implicit Insight Distillation (IID) to resolve the trade-off between evaluation reliability and inference speed, distilling complex metric insights into a lightweight student model. Our approach offers the first comprehensive solution for reliable and scalable long-form video production.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。