在人脸中嵌入可学习的隐藏面孔,实现对深度伪造的主动防御。
Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Face
- 通过可逆隐写网络将秘密人脸模板嵌入图像,作为伪造检测信号。
- 在多个数据集上优于主流被动与主动检测方法,准确率显著提升。
- 适合需要主动防护深度伪造的应用场景,如内容安全与数字取证。
随着深度伪造技术持续演进,传统被动检测方法难以泛化应对多种篡改手法和数据集。主动防御技术被广泛研究,旨在有效阻止深度伪造行为。本文旨在弥合被动检测与主动防御之间的差距,提出一种基于主动策略的检测新方法。受多种基于水印的取证技术启发,我们提出一种创新框架:在人脸图像中嵌入一个可学习的隐藏面部。具体而言,利用半脆弱可逆隐写网络,将秘密模板图像不可察觉地嵌入宿主图像中,当通过逆隐写过程恢复时,该模板可作为检测恶意篡改的指示器。秘密模板并非手动设定,而是在训练过程中优化为中性人脸特征,如同图像中的“监视者”。结合自融合机制与鲁棒性学习策略,并模拟传输信道,构建出鲁棒检测器,能够准确区分隐写图像是否遭受恶意篡改或仅经良性处理。大量实验在多个数据集上验证了该方法在性能上超越现有被动与主动检测方法。
原文摘要 · Abstract (English)
As deepfake technologies continue to advance, passive detection methods struggle to generalize with various forgery manipulations and datasets. Proactive defense techniques have been actively studied with the primary aim of preventing deepfake operation effectively working. In this paper, we aim to bridge the gap between passive detection and proactive defense, and seek to solve the detection problem utilizing a proactive methodology. Inspired by several watermarking-based forensic methods, we explore a novel detection framework based on the concept of ``hiding a learnable face within a face''. Specifically, relying on a semi-fragile invertible steganography network, a secret template image is embedded into a host image imperceptibly, acting as an indicator monitoring for any malicious image forgery when being restored by the inverse steganography process. Instead of being manually specified, the secret template is optimized during training to resemble a neutral facial appearance, just like a ``big brother'' hidden in the image to be protected. By incorporating a self-blending mechanism and robustness learning strategy with a simulative transmission channel, a robust detector is built to accurately distinguish if the steganographic image is maliciously tampered or benignly processed. Finally, extensive experiments conducted on multiple datasets demonstrate the superiority of the proposed approach over competing passive and proactive detection methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。