FaceShield通过干扰扩散模型生成人脸时的注意力机制,实现对深度伪造的主动防御。
FaceShield: Defending Facial Image against Deepfake Threats

- 针对扩散模型设计注意力干扰策略,屏蔽关键面部特征
- 在CelebA-HQ与VGGFace2-HQ上对最新扩散模型达到领先防御效果
- 适用于多种生成模型,噪声隐蔽性高且抗压缩能力强
深度伪造在犯罪活动中的泛滥引发广泛关注。现有研究多聚焦于检测,但属被动响应,难以应对真实性被忽视的攻击场景。现有主动防御方法仅适用于特定生成对抗网络(GAN)模型,难以应对近期兴起的扩散模型(DMs)。本文提出主动防御方法FaceShield,针对扩散模型和多种已有GAN模型设计新型防御策略。方法包含三部分:(i) 干扰扩散模型的注意力机制,在去噪过程中排除受保护面部特征;(ii) 针对主流面部特征提取器增强对抗扰动的鲁棒性;(iii) 使用高斯模糊与低通滤波提升扰动隐蔽性,并增强对JPEG压缩的鲁棒性。在CelebA-HQ与VGGFace2-HQ数据集上的实验表明,该方法在防御基于扩散模型的最新深度伪造方面达到当前最优性能,同时具备向GAN模型迁移的能力,且噪声更隐蔽、抗压缩能力更强。代码已开源。
原文摘要 · Abstract (English)
The rising use of deepfakes in criminal activities presents a significant issue, inciting widespread controversy. While numerous studies have tackled this problem, most primarily focus on deepfake detection. These reactive solutions are insufficient as a fundamental approach for crimes where authenticity is disregarded. Existing proactive defenses also have limitations, as they are effective only for deepfake models based on specific Generative Adversarial Networks (GANs), making them less applicable in light of recent advancements in diffusion-based models. In this paper, we propose a proactive defense method named FaceShield, which introduces novel defense strategies targeting deepfakes generated by Diffusion Models (DMs) and facilitates defenses on various existing GAN-based deepfake models through facial feature extractor manipulations. Our approach consists of three main components: (i) manipulating the attention mechanism of DMs to exclude protected facial features during the denoising process, (ii) targeting prominent facial feature extraction models to enhance the robustness of our adversarial perturbation, and (iii) employing Gaussian blur and low-pass filtering techniques to improve imperceptibility while enhancing robustness against JPEG compression. Experimental results on the CelebA-HQ and VGGFace2-HQ datasets demonstrate that our method achieves state-of-the-art performance against the latest deepfake models based on DMs, while also exhibiting transferability to GANs and showcasing greater imperceptibility of noise along with enhanced robustness. Code is available here: https://github.com/kuai-lab/iccv25_faceshield
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。