arXiv:2607.03562cs.CV2026-07

构建百万级可解释深度伪造检测数据集,让模型解释更可信。

XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection

  • 百万级图像数据集,含真实与合成图像
  • 提出实体与证据得分,量化解释真实性
  • 支持专家与普通用户双类解释,提升可读性

随着深度伪造检测模型生成自然语言解释,其推理往往缺乏对视觉痕迹的扎实依据,影响可靠性与用户信任。现有基准主要评估分类准确率,忽视解释是否反映真实篡改行为。为此,我们提出XPlainVerse,一个大规模基准,用于联合深度伪造检测与以人为中心的解释。该数据集包含一百万张真实与伪造图像,源自五个公开来源的真实图像,以及由十二种现成图像编辑与合成模型生成的伪造图像。我们进一步设计多阶段过滤流程Edit-Check,验证篡改是否符合预期操作,实现大规模可靠推理监督。除规模外,XPlainVerse提供两种解释风格:面向专家的技术解释和面向非技术用户的简化解释。为评估解释质量,我们提出新指标EntityScore与EvidenceScore,通过检查解释是否正确识别被篡改实体与视觉证据来衡量推理保真度。2000对解释的人工标注验证了数据质量与人类判断的一致性。我们认为XPlainVerse将建立可量化的解释质量维度,推动可信、可解释模型的规模化研究。

原文摘要 · Abstract (English)

As deepfake detection models increasingly produce natural language explanations, their reasoning often remains weakly grounded in visual artifacts, limiting reliability and user trust. Existing benchmarks mainly evaluate classification accuracy, overlooking whether explanations reflect the actual manipulations. This gap hinders progress toward deployable, explainable deepfake detection systems. To this end, we introduce XPlainVerse, a large-scale benchmark designed for joint deepfake detection and human-centered explanation. XPlainVerse comprises one million real and manipulated images, pairing authentic images from five established sources with forgeries generated by twelve off-the-shelf image editing and synthesis models. We further propose a multi-stage filtering pipeline, Edit-Check, to verify if manipulations satisfy their intended edits, enabling reliable reasoning supervision at scale. Beyond dataset scale, XPlainVerse provides two complementary explanation styles: technical explanations for expert analysis and simplified explanations optimized for non-technical users. To evaluate explanation quality beyond surface similarity, we propose novel metrics, EntityScore and EvidenceScore, that measure reasoning fidelity by checking whether explanations correctly identify manipulated entities and visual evidence. Human annotations on 2,000 explanation pairs validate our dataset quality against human judgment. We believe XPlainVerse will establish grounded explanation quality as a measurable dimension of deepfake detection and support scalable research on trustworthy, interpretable models.

深度伪造可解释性数据集可信AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。