构建首个大规模多模态深度伪造检测基准,验证大模型的检测与逃逸能力。
DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models
- 设计跨12种生成模型的多源数据集,覆盖真实、编辑与生成图像。
- 提出多智能体融合检测框架,零样本下达到当前最优检测准确率。
- 适合关注生成内容安全、大模型泛化能力的研究者使用。
随着生成模型快速发展,AI生成图像的真实感显著提升,对数字内容真实性验证带来严峻挑战。现有深度伪造检测方法多依赖生成模型和内容多样性有限的数据集,难以跟上生成内容日益复杂和逼真的演进。大规模多模态模型(LMMs)在各类视觉任务中表现出强大的零样本能力,但在深度伪造检测中的潜力尚未充分探索。为此,我们提出 extbf{DFBench},一个大规模深度伪造检测基准,具备三大特点:(i) 广泛多样性,包含54万张涵盖真实、AI编辑和AI生成内容的图像;(ii) 最新生成模型,虚假图像由12个当前最先进的生成模型生成;(iii) 双向评估机制,同时测试检测器的准确率与生成模型的逃避能力。基于DFBench,我们提出 extbf{MoA-DF}——用于深度伪造检测的多智能体混合模型,通过整合多个LMM的联合概率策略实现卓越性能,进一步验证了利用LMM进行深度伪造检测的有效性。数据集与代码已公开于https://github.com/IntMeGroup/DFBench。
原文摘要 · Abstract (English)
With the rapid advancement of generative models, the realism of AI-generated images has significantly improved, posing critical challenges for verifying digital content authenticity. Current deepfake detection methods often depend on datasets with limited generation models and content diversity that fail to keep pace with the evolving complexity and increasing realism of the AI-generated content. Large multimodal models (LMMs), widely adopted in various vision tasks, have demonstrated strong zero-shot capabilities, yet their potential in deepfake detection remains largely unexplored. To bridge this gap, we present \textbf{DFBench}, a large-scale DeepFake Benchmark featuring (i) broad diversity, including 540,000 images across real, AI-edited, and AI-generated content, (ii) latest model, the fake images are generated by 12 state-of-the-art generation models, and (iii) bidirectional benchmarking and evaluating for both the detection accuracy of deepfake detectors and the evasion capability of generative models. Based on DFBench, we propose \textbf{MoA-DF}, Mixture of Agents for DeepFake detection, leveraging a combined probability strategy from multiple LMMs. MoA-DF achieves state-of-the-art performance, further proving the effectiveness of leveraging LMMs for deepfake detection. Database and codes are publicly available at https://github.com/IntMeGroup/DFBench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。