arXiv:2509.17550cs.AIcs.CV2025-09ICCV被引 3

首次系统分析深度伪造检测中的不确定性,揭示生成痕迹如何影响判断可靠性。

Is It Certainly a Deepfake? Reliability Analysis in Detection & Generation Ecosystem

论文配图:Is It Certainly a Deepfake? Reliability Analysis in Detection & Generation Ecosystem
图 1 · 摘自论文原文
  • 用贝叶斯神经网络与蒙特卡洛丢弃量化检测器的两种不确定性。
  • 在九个生成器、两组检测器上验证,发现置信度与生成特征高度相关。
  • 提出像素级置信度图,可定位特定生成器留下的痕迹模式。

随着生成模型在质量和数量上的进步,深度伪造内容引发网络信任危机。尽管已有检测器应对,但误判(将假当真或真当假)反而加剧了虚假信息传播。本文首次对深度伪造检测器进行系统性不确定性分析,研究生成伪影如何影响预测置信度。由于不同生成器产生的残留特征各异,我们交叉分析了检测器与生成器的不确定性。结果表明,不确定性流形中蕴含足够一致信息,可用于溯源检测。方法基于贝叶斯神经网络与蒙特卡洛丢弃,量化多种检测架构中的偶然性与认知性不确定性。在两个数据集上评估九个生成器、四组盲检与两组生物检测器,比较不同不确定性方法,探索区域与像素级不确定性,并进行消融实验。通过二分类、多分类、源检测及留一法实验,评估生成器与检测器组合的泛化能力、模型校准、不确定性表现及对抗攻击鲁棒性。进一步提出不确定性热力图,实现像素级置信度定位,揭示与特定生成器相关的显著模式。分析为部署可靠深度伪造检测系统提供关键洞见,并确立不确定性量化为可信合成媒体检测的基础要求。

原文摘要 · Abstract (English)

As generative models are advancing in quality and quantity for creating synthetic content, deepfakes begin to cause online mistrust. Deepfake detectors are proposed to counter this effect, however, misuse of detectors claiming fake content as real or vice versa further fuels this misinformation problem. We present the first comprehensive uncertainty analysis of deepfake detectors, systematically investigating how generative artifacts influence prediction confidence. As reflected in detectors' responses, deepfake generators also contribute to this uncertainty as their generative residues vary, so we cross the uncertainty analysis of deepfake detectors and generators. Based on our observations, the uncertainty manifold holds enough consistent information to leverage uncertainty for deepfake source detection. Our approach leverages Bayesian Neural Networks and Monte Carlo dropout to quantify both aleatoric and epistemic uncertainties across diverse detector architectures. We evaluate uncertainty on two datasets with nine generators, with four blind and two biological detectors, compare different uncertainty methods, explore region- and pixel-based uncertainty, and conduct ablation studies. We conduct and analyze binary real/fake, multi-class real/fake, source detection, and leave-one-out experiments between the generator/detector combinations to share their generalization capability, model calibration, uncertainty, and robustness against adversarial attacks. We further introduce uncertainty maps that localize prediction confidence at the pixel level, revealing distinct patterns correlated with generator-specific artifacts. Our analysis provides critical insights for deploying reliable deepfake detection systems and establishes uncertainty quantification as a fundamental requirement for trustworthy synthetic media detection.

深度伪造不确定性检测溯源贝叶斯网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。