大模型生成的假图像视频,特征值普遍更小,可直接用来检测深度伪造。
Foundation Models are Implicit Deepfake Detectors

- 用特征幅度大小区分真假媒体,无需复杂模型。
- 假内容特征幅度平均低15%-20%,效果媲美顶尖检测方法。
- 模型越大,检测能力越强,适合零样本检测场景。
预训练自监督表征已成为当前深度伪造检测的核心组件,但其为何能区分真实与虚假媒体仍不明确。本文发现一个惊人一致的现象:在多个预训练模型、数据集及图像与视频领域中,虚假样本的表征幅度系统性低于真实样本。基于此,我们将深度伪造检测建模为异常检测问题,证明仅通过特征幅度的简单统计即可达到与复杂方法相当的性能。进一步研究显示,特征幅度降低主要源于虚假内容带来的语义偏移,而低层次生成痕迹作用较小。最后,我们发现该判别信号随基础模型规模增大而增强,表明表征学习的进步自然转化为更强的零样本深度伪造检测能力。
原文摘要 · Abstract (English)
Pretrained self-supervised representations have emerged as a core component of current deepfake detection methods, yet it remains unclear which of their properties make real and fake media distinguishable. In this work, we uncover a surprisingly consistent phenomenon: across multiple pretrained models, datasets, and both image and video domains, fake samples systematically produce lower-magnitude representations than their real counterparts. Motivated by this finding, we formulate deepfake detection as an anomaly detection problem and show that simple statistics of feature magnitude achieve competitive performance with far more sophisticated deepfake detection methods. We further investigate the origin of this effect and demonstrate that reduced feature magnitude is primarily associated with semantic shifts introduced by fake content, while low-level generative fingerprints play a comparatively smaller role. Finally, we show that this discriminative signal strengthens as the size of the underlying foundation model grows, suggesting that advances in representation learning naturally translate into stronger zero-shot deepfake detectors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。