arXiv:2605.26244cs.CVcs.MM2026-05被引 5

构建首个分钟级音视频生成统一评估基准,支持多模态输入。

LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AV

论文配图:LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AV
图 1 · 摘自论文原文
  • 设计跨文本、图像、视频条件的统一评估框架
  • 覆盖284个测试用例,涵盖20+细粒度评估维度
  • 适合研究长时序音视频生成与对齐的学者使用

音视频生成正从短片段迈向分钟级内容,但现有评估体系仍局限于短时场景。现有基准主要聚焦5-10秒的文本驱动生成,难以统一评估文本、图像和视频条件下的生成能力,且缺乏对身份一致性、叙事连贯性和音视频对齐随时间退化的深入分析。为此,我们提出LongAV-Compass,一个系统性的分钟级音视频生成评估基准。该基准包含284个精心筛选的测试用例,覆盖文本到音视频(T2AV)、图像到音视频(I2AV)和视频到音视频(V2AV),按应用场景和生成复杂度组织。评估框架融合多模态大模型辅助评估与互补的感知及多模态指标(如DINO-v2、ArcFace、CLIP、ImageBind),全面评估超过20个细粒度维度,包括段内质量、段间一致性、全局叙事连贯性、语义对齐与音视频同步性。通过对11个代表性模型的实验及人工对齐验证,LongAV-Compass为分析当前系统在跨模态、长时间跨度下保持语义一致与时空连贯的局限性提供了诊断工具。

原文摘要 · Abstract (English)

Audio-visual generation is rapidly advancing from short clips to minute-long content, while existing evaluation protocols remain largely confined to short-form settings. Existing benchmarks primarily focus on 5--10 second text-conditioned generation and rarely support unified evaluation across text, image, and video conditioning modalities. Moreover, they provide limited insight into how identity consistency, narrative coherence, and audio-visual alignment degrade over extended temporal horizons. To bridge this gap, we introduce LongAV-Compass, a systematic benchmark for minute-long audio-visual generation. LongAV-Compass contains 284 curated test cases spanning text-to-audio-video (T2AV), image-to-audio-video (I2AV), and video-to-audio-video (V2AV), organized by application scenario and generation complexity. The benchmark combines taxonomy-guided benchmark construction with a unified evaluation framework that integrates MLLM-assisted assessment with complementary perceptual and multimodal metrics, including DINO-v2, ArcFace, CLIP, and ImageBind. The framework evaluates more than 20 fine-grained dimensions covering within-segment quality, cross-segment consistency, global narrative coherence, semantic alignment, and audio-visual synchronization. Through experiments on 11 representative models together with human-alignment validation, LongAV-Compass provides a diagnostic testbed for analyzing the limitations of current systems in sustaining coherent, semantically aligned, and temporally consistent minute-scale audio-visual generation across diverse input modalities.

音视频生成多模态评估长时序统一基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。