arXiv:2601.14738cs.CV2026-01被引 2

通过破坏人脸交换的路径链,有效抵御扩散模型换脸攻击

Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruption

  • 将换脸视为耦合身份路径,从关键瓶颈注入扰动
  • 在生成阶段解耦注意力并污染中间特征,阻断身份重建
  • 保持视觉自然,适合隐私保护与安全防御场景

扩散模型的快速发展使人脸换脸技术普及,但也带来隐私与身份安全风险。现有主动防御方法多源自图像编辑攻击,难以应对此类威胁。我们发现其失效源于忽视了换脸系统中固有的结构鲁棒性与静态条件引导机制。为此,提出VoidFace,一种系统性防御方法,将换脸视为耦合的身份路径。通过在关键瓶颈注入扰动,引发全链路级联破坏:首先引入定位干扰与身份擦除,削弱物理回归与语义嵌入,阻碍源人脸建模;随后在生成域解耦注意力机制,切断身份注入,并污染中间扩散特征,阻止源身份重建。为保证视觉不可察觉,基于感知自适应策略,在潜在空间进行对抗搜索,平衡攻击强度与图像质量。大量实验表明,VoidFace在多种扩散模型换脸系统上均优于现有防御,且生成对抗样本视觉质量更优。

原文摘要 · Abstract (English)

The rapid evolution of diffusion models has democratized face swapping but also raises concerns about privacy and identity security. Existing proactive defenses, often adapted from image editing attacks, prove ineffective in this context. We attribute this failure to an oversight of the structural resilience and the unique static conditional guidance mechanism inherent in face swapping systems. To address this, we propose VoidFace, a systemic defense method that views face swapping as a coupled identity pathway. By injecting perturbations at critical bottlenecks, VoidFace induces cascading disruption throughout the pipeline. Specifically, we first introduce localization disruption and identity erasure to degrade physical regression and semantic embeddings, thereby impairing the accurate modeling of the source face. We then intervene in the generative domain by decoupling attention mechanisms to sever identity injection, and corrupting intermediate diffusion features to prevent the reconstruction of source identity. To ensure visual imperceptibility, we perform adversarial search in the latent manifold, guided by a perceptual adaptive strategy to balance attack potency with image quality. Extensive experiments show that VoidFace outperforms existing defenses across various diffusion-based swapping models, while producing adversarial faces with superior visual quality.

人脸识别扩散模型隐私安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。