arXiv:2411.17209cs.CV2024-11中稿 · ACM MM 2024被引 45

用不可见水印提前标记人脸,实时识别深度伪造

LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarks

  • 从面部关键点生成不可见水印,无需训练
  • 在跨数据集和伪造类型下水印恢复准确率超90%
  • 适合需要实时防护的社交平台与安防系统

深度伪造人脸技术因其对用户体验的提升与隐私威胁引发广泛关注。尽管已有诸多被动检测方法,但在面对高度逼真的合成图像时普遍面临泛化能力差的问题。为此,本文提出一种主动检测新方法——LampMark,通过引入无需训练的地标感知水印机制。首先分析深度伪造对结构特征的敏感性,设计从面部关键点到二进制水印的安全转换流程;随后构建端到端水印嵌入与提取框架,实现对目标图像的不可见且鲁棒的水印保护。通过比对内容匹配的水印与可疑图像中恢复的水印一致性,完成深度伪造检测。实验表明,在同数据集、跨数据集及跨伪造方法场景下,本方法在水印恢复与检测性能上均优于现有最先进方法。

原文摘要 · Abstract (English)

Deepfake facial manipulation has garnered significant public attention due to its impacts on enhancing human experiences and posing privacy threats. Despite numerous passive algorithms that have been attempted to thwart malicious Deepfake attacks, they mostly struggle with the generalizability challenge when confronted with hyper-realistic synthetic facial images. To tackle the problem, this paper proposes a proactive Deepfake detection approach by introducing a novel training-free landmark perceptual watermark, LampMark for short. We first analyze the structure-sensitive characteristics of Deepfake manipulations and devise a secure and confidential transformation pipeline from the structural representations, i.e. facial landmarks, to binary landmark perceptual watermarks. Subsequently, we present an end-to-end watermarking framework that imperceptibly and robustly embeds and extracts watermarks concerning the images to be protected. Relying on promising watermark recovery accuracies, Deepfake detection is accomplished by assessing the consistency between the content-matched landmark perceptual watermark and the robustly recovered watermark of the suspect image. Experimental results demonstrate the superior performance of our approach in watermark recovery and Deepfake detection compared to state-of-the-art methods across in-dataset, cross-dataset, and cross-manipulation scenarios.

深度伪造水印技术主动检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。