用隐形扰动破坏人脸篡改,防止身份泄露。
ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification
- 通过编码解码网络生成跨模型通用扰动。
- 有效干扰多种人脸篡改模型,破坏可识别特征。
- 可嵌入其他任务,适合安全防御场景。
深度学习驱动的人脸篡改严重威胁公民权利。为从源头防范此类欺诈,现有主动防御方法在图像中嵌入不可见的对抗扰动,干扰篡改过程,使伪造结果缺乏可信度。然而,非目标性干扰可能保留可识别面部特征,导致个体被错误标记。本文提出通用防御框架ID-Guard,利用单次前向传播的编码解码网络生成跨模型可迁移的对抗扰动,并引入新型身份破坏模块(IDM)抑制篡改人脸中的可识别特征。扰动生成通过多任务学习优化,动态加权策略提升跨模型性能。实验表明,ID-Guard能有效防御多种人脸篡改模型,同时降低篡改图像中可识别区域的完整性;所生成图像还可规避人脸修复与人脸识别系统。此外,该框架可作为即插即用组件集成至其他任务(如对抗训练)。源代码已公开于https://github.com/ZOMIN28/ID-Guard。
原文摘要 · Abstract (English)
The misuse of deep learning-based facial manipulation poses a serious threat to civil rights. To prevent such fraud at its source, proactive defense methods have been proposed that embed invisible adversarial perturbations into images, disrupting the manipulation process and rendering the forged output unconvincing to observers. However, non-targeted disruption of the output may leave identifiable facial features intact, potentially leading to the stigmatization of individuals. In this work, we propose a universal framework for combating facial manipulation, termed ID-Guard. The framework employs a single forward pass of an encoder-decoder network to generate cross-model transferable adversarial perturbations. We introduce a novel Identity Destruction Module (IDM) to suppress identifiable features in manipulated faces. The perturbation generation is optimized by formulating the disruption of various manipulation types as a multi-task learning problem, with a dynamic weighting strategy designed to enhance cross-model performance. Experimental results show that ID-Guard effectively defends against diverse facial manipulation models while degrading identifiable regions in manipulated images. It also enables disrupted images to evade facial inpainting and facial recognition systems. Moreover, ID-Guard can be seamlessly integrated as a plug-and-play component into other tasks, such as adversarial training. The source code is publicly available at https://github.com/ZOMIN28/ID-Guard.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。