arXiv:2512.10652cs.CVcs.CR2025-12被引 2

构建可解释伪造检测基准,评估识别、判断与解释的可靠性。

TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection

  • 设计三维度评测框架:感知、检测、幻觉
  • 覆盖16类跨模态伪造,验证模型真实表现
  • 揭示解释不可靠会严重干扰检测决策

生成建模技术的进步使得伪造个人形象变得愈发逼真,对安全、传播与公众信任构成严重威胁。可靠检测此类人物驱动的篡改内容,不仅需区分真实与伪造媒体,还需提供清晰可信的推理过程。本文提出TriDF,一个面向可解释DeepFake检测的综合性基准。该基准包含来自先进合成模型的高质量伪造内容,覆盖图像、视频和音频模态中的16种伪造类型。评测涵盖三个核心维度:感知(Perception)——通过人工标注证据评估模型识别细微篡改痕迹的能力;检测(Detection)——在多样化伪造家族与生成器下评估分类性能;幻觉(Hallucination)——量化模型生成解释的可靠性。基于前沿多模态大语言模型的实验表明,精准感知是可靠检测的基础,但幻觉会严重破坏决策,揭示三者间的内在关联。TriDF为理解检测准确性、证据识别与解释可靠性之间的交互关系提供了统一框架,为构建应对现实合成媒体威胁的可信系统奠定基础。

原文摘要 · Abstract (English)

Advances in generative modeling have made it increasingly easy to fabricate realistic portrayals of individuals, creating serious risks for security, communication, and public trust. Detecting such person-driven manipulations requires systems that not only distinguish altered content from authentic media but also provide clear and reliable reasoning. In this paper, we introduce TriDF, a comprehensive benchmark for interpretable DeepFake detection. TriDF contains high-quality forgeries from advanced synthesis models, covering 16 DeepFake types across image, video, and audio modalities. The benchmark evaluates three key aspects: Perception, which measures the ability of a model to identify fine-grained manipulation artifacts using human-annotated evidence; Detection, which assesses classification performance across diverse forgery families and generators; and Hallucination, which quantifies the reliability of model-generated explanations. Experiments on state-of-the-art multimodal large language models show that accurate perception is essential for reliable detection, but hallucination can severely disrupt decision-making, revealing the interdependence of these three aspects. TriDF provides a unified framework for understanding the interaction between detection accuracy, evidence identification, and explanation reliability, offering a foundation for building trustworthy systems that address real-world synthetic media threats.

深度伪造可解释性多模态评测基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。