通过优化扰动分布与频率,实现近乎无感的换脸防御。
SRAP: SVD-Refined Adversarial Perturbations for Imperceptible Face-Swap Defense

- 用SVD分解和身份敏感掩码,聚焦关键区域并抑制高频噪声。
- 在CelebA-HQ和VGGFace2-HQ上,图像保真度显著提升,防御效果不降。
- 适合关注隐私保护与视觉质量平衡的防御研究者。
深度伪造技术对人脸隐私与身份安全构成日益增长的威胁,推动了事前防御机制的发展。尽管投影梯度下降(PGD)生成的对抗扰动可干扰换脸模型的身份表征,但其视觉质量受两大特性影响:扰动广泛分布于图像,包括身份不敏感区域;且包含显著的高频视觉成分。我们通过身份敏感性估计和PGD扰动的奇异值分解(SVD)分析这些空间与频谱效率低下问题。结果表明,后方奇异分量包含过多高频能量,而前方分量保留了大部分扰动能量与防御效用。基于此,我们提出SRAP,每轮优化中结合通道级截断SVD精炼与身份重要性掩码。SVD精炼抑制高秩、高频残差,掩码则限制扰动集中在强影响身份的区域。在CelebA-HQ和VGGFace2-HQ上的实验表明,SRAP在所有评测指标下显著提升保护图像的保真度,同时保持竞争性的身份破坏性能,实现了换脸防御与视觉无感之间的良好权衡。
原文摘要 · Abstract (English)
Deepfake technologies pose increasing threats to facial privacy and identity security, motivating proactive defenses that protect facial images before misuse. Although adversarial perturbations generated by projected gradient descent (PGD) can disrupt the identity representations used by face-swapping models, their visual quality is degraded by two characteristics: perturbations are distributed broadly over the image, including identity-insensitive regions, and they contain visually salient high-frequency components. We analyze these spatial and spectral inefficiencies through identity-sensitivity estimation and the singular-value decomposition (SVD) of PGD perturbations. Our analysis shows that later singular components contain a disproportionate amount of high-frequency energy, while the leading components preserve most of the perturbation energy and defense utility. Based on these observations, we propose SRAP, which combines per-channel truncated SVD refinement with an identity-importance mask at every optimization step. The SVD refinement suppresses high-rank, high-frequency residuals, while the mask restricts perturbations to locations that strongly influence identity representations. Experiments on CelebA-HQ and VGGFace2-HQ demonstrate that SRAP substantially improves protected-image fidelity across all reported metrics while maintaining competitive identity-disruption performance, yielding a favorable trade-off between face-swap defense and visual imperceptibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。