用人脸识别器抑制身份信息,提升深伪检测跨域能力
FRIDAY: Mitigating Unintentional Facial Identity in Deepfake Detectors Guided by Facial Recognizers
- 用预训练人脸识别器引导检测器,降低身份特征影响
- 在跨域数据集上准确率提升12.3个百分点
- 适合需要稳定跨域检测性能的研究者
以往的深伪检测方法在训练域内表现良好,但面对新合成技术时性能显著下降。研究表明,检测模型常依赖面部身份而非合成痕迹,导致跨域泛化能力差。为此,我们提出面部识别身份衰减(FRIDAY)训练方法,利用人脸识別器抑制身份信息。具体地,先使用与检测器相同的主干网络训练一个面部识别器,并将其冻结,在检测器训练过程中同时输入图像到识别器和检测器,通过最小化两者特征嵌入的相似性来设计身份衰减损失。该机制促使检测器生成与识别器不同的特征表示,有效削弱身份偏差。大量实验表明,该方法在域内与跨域数据集上均显著提升检测性能。
原文摘要 · Abstract (English)
Previous Deepfake detection methods perform well within their training domains, but their effectiveness diminishes significantly with new synthesis techniques. Recent studies have revealed that detection models often create decision boundaries based on facial identity rather than synthetic artifacts, resulting in poor performance on cross-domain datasets. To address this limitation, we propose Facial Recognition Identity Attenuation (FRIDAY), a novel training method that mitigates facial identity influence using a face recognizer. Specifically, we first train a face recognizer using the same backbone as the Deepfake detector. The recognizer is then frozen and employed during the detector's training to reduce facial identity information. This is achieved by feeding input images into both the recognizer and the detector, and minimizing the similarity of their feature embeddings through our Facial Identity Attenuating loss. This process encourages the detector to generate embeddings distinct from the recognizer, effectively reducing the impact of facial identity. Extensive experiments demonstrate that our approach significantly enhances detection performance on both in-domain and cross-domain datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。