arXiv:2505.04460cs.CV2025-05IJCAI被引 8

通过学习真实人脸的全面概念,提升深度伪造检测的泛化能力。

Learning Real Facial Concepts for Independent Deepfake Detection

论文配图:Learning Real Facial Concepts for Independent Deepfake Detection
图 1 · 摘自论文原文
  • 构建真实人脸原型库,捕捉真实类别的完整概念
  • 独立判断真实与伪造概率,降低对伪造痕迹的依赖
  • 在5个数据集上平均准确率提升1.74%,适合跨域检测场景

深度伪造检测模型常因泛化能力差,在目标域中将真实样本误判为伪造。这主要源于对伪造痕迹的过度依赖和对真实人脸理解不足。为此,我们提出新方法RealID,通过学习全面的真实人脸概念并独立评估真实与伪造类别概率,以增强泛化性。RealID包含两个核心模块:真实概念捕捉模块(RealC2)和独立双决策分类器(IDC)。RealC2借助多真实记忆库维护多种真实人脸原型,实现对真实类别的完整表征;IDC则重新定义分类策略,分别基于真实概念和伪造痕迹进行独立决策。二者协同作用有效缓解了非伪造相关模式的影响。在五个常用数据集上的大量实验表明,RealID显著优于现有最先进方法,平均准确率提升1.74%。

原文摘要 · Abstract (English)

Deepfake detection models often struggle with generalization to unseen datasets, manifesting as misclassifying real instances as fake in target domains. This is primarily due to an overreliance on forgery artifacts and a limited understanding of real faces. To address this challenge, we propose a novel approach RealID to enhance generalization by learning a comprehensive concept of real faces while assessing the probabilities of belonging to the real and fake classes independently. RealID comprises two key modules: the Real Concept Capture Module (RealC2) and the Independent Dual-Decision Classifier (IDC). With the assistance of a MultiReal Memory, RealC2 maintains various prototypes for real faces, allowing the model to capture a comprehensive concept of real class. Meanwhile, IDC redefines the classification strategy by making independent decisions based on the concept of the real class and the presence of forgery artifacts. Through the combined effect of the above modules, the influence of forgery-irrelevant patterns is alleviated, and extensive experiments on five widely used datasets demonstrate that RealID significantly outperforms existing state-of-the-art methods, achieving a 1.74% improvement in average accuracy.

深度伪造检测真实人脸建模独立分类跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。