arXiv:2412.01101cs.CVcs.CR2024-12被引 9

用干扰检测器的方法,让伪造视频无法提取人脸。

Hiding Faces in Plain Sight: Defending DeepFakes by Disrupting Face Detection

  • 在视频帧中添加对抗扰动,骗过人脸识别模型。
  • 跨帧传播扰动,计算开销降低80%以上。
  • 适合作为防深度伪造的主动防御工具。

人脸换脸深度伪造已成社会隐患,近年备受关注。本文提出一种主动防御框架,通过干扰深度伪造模型的输入源——人脸检测器,阻止受害者人脸被提取。核心思路是:多数深度伪造技术依赖人脸检测器自动定位目标面部,若检测器失效,伪造过程将受阻。为此,我们设计了名为FacePoison的策略,在视频帧中加入特定对抗扰动以欺骗检测器;进一步提出VideoFacePoison,可跨帧高效传播扰动,显著降低计算开销。该框架在五个主流人脸检测器上验证,对十一种不同深度伪造模型均表现出强抑制效果。代码已开源。

原文摘要 · Abstract (English)

Face-swapping DeepFakes have become an escalating societal concern, attracting increasing attention in recent years. To counter this, we investigate a new proactive defense framework to prevent individuals from being victimized in DeepFake videos. The core idea of this framework is to contaminate the inputs of DeepFake models by disrupting face detectors, based on the observation that face detectors are commonly used to automatically extract victim faces in most DeepFake techniques. Once the face detectors malfunction, the faces will not be correctly extracted, thereby impairing the training or synthesis stages of DeepFake models. To achieve this, we describe a strategy named {\em FacePoison}, which fools face detectors by adding dedicated adversarial perturbations to video frames. Building upon this, we introduce {\em VideoFacePoison}, an extended strategy that can efficiently propagate FacePoison across video frames instead of applying it individually to each frame, thus significantly reducing the computational overhead while retaining favorable attack performance. This framework is validated on five face detectors, and extensive experiments against eleven different DeepFake models demonstrate the effectiveness of disrupting face detectors to hinder DeepFake generation. The source code is publicly available at: https://github.com/OUC-VAS/FacePoison.

深度伪造对抗攻击人脸检测主动防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。