arXiv:2508.10771cs.CVcs.AI2025-08被引 5

构建超真实视频伪造检测基准,评估大模型真实识别能力。

AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences

  • 构建包含1万+视频的大型基准数据集,覆盖多种先进生成模型。
  • 现有视觉语言模型在挑战性子集上检测率不足,暴露能力局限。
  • 适合研究视频真实性检测、伪造识别与多模态融合的学者使用。

近期人工智能生成内容的发展催生了高度逼真的合成视频,严重威胁社会信任与数字完整性。现有视频真实性检测基准普遍存在真实性不足、规模有限、复杂度不够的问题,难以有效评估现代视觉-语言模型对复杂伪造视频的检测能力。为此,我们提出AEGIS,一个专注于超真实、语义细腻的AI生成视频检测的大型基准。AEGIS包含超过10,000个经过严格筛选的真实与合成视频,由Stable Video Diffusion、CogVideoX-5B、KLing、Sora等多样化的前沿生成模型生成,涵盖开源与专有架构。特别地,数据集设计了具有鲁棒性评估功能的高难度子集。同时提供跨模态标注,包括语义-真实性描述、运动特征与低层视觉特征,支持多模态融合与伪造定位等下游任务。大量实验表明,先进视觉-语言模型在最困难子集上表现不佳,凸显AEGIS的独特复杂性与现实逼真度已超出当前模型泛化能力。AEGIS为研发真正稳健、可靠、可广泛适用的视频真实性检测方法提供了关键评估标准。数据集已公开于https://huggingface.co/datasets/Clarifiedfish/AEGIS。

原文摘要 · Abstract (English)

Recent advances in AI-generated content have fueled the rise of highly realistic synthetic videos, posing severe risks to societal trust and digital integrity. Existing benchmarks for video authenticity detection typically suffer from limited realism, insufficient scale, and inadequate complexity, failing to effectively evaluate modern vision-language models against sophisticated forgeries. To address this critical gap, we introduce AEGIS, a novel large-scale benchmark explicitly targeting the detection of hyper-realistic and semantically nuanced AI-generated videos. AEGIS comprises over 10,000 rigorously curated real and synthetic videos generated by diverse, state-of-the-art generative models, including Stable Video Diffusion, CogVideoX-5B, KLing, and Sora, encompassing open-source and proprietary architectures. In particular, AEGIS features specially constructed challenging subsets enhanced with robustness evaluation. Furthermore, we provide multimodal annotations spanning Semantic-Authenticity Descriptions, Motion Features, and Low-level Visual Features, facilitating authenticity detection and supporting downstream tasks such as multimodal fusion and forgery localization. Extensive experiments using advanced vision-language models demonstrate limited detection capabilities on the most challenging subsets of AEGIS, highlighting the dataset's unique complexity and realism beyond the current generalization capabilities of existing models. In essence, AEGIS establishes an indispensable evaluation benchmark, fundamentally advancing research toward developing genuinely robust, reliable, broadly generalizable video authenticity detection methodologies capable of addressing real-world forgery threats. Our dataset is available on https://huggingface.co/datasets/Clarifiedfish/AEGIS.

视频伪造真实性检测多模态基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。