一个水印框架同时实现伪造检测、定位与溯源,防篡改能力强。
All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermark
- 用152维面部特征水印融合源标识,统一三个取证任务。
- 在严重扭曲下仍能准确还原水印,检测与定位精度超95%。
- 适合需要全流程伪造内容追踪的隐私保护场景。
随着深度伪造技术的快速发展,恶意人脸操作对个人隐私和社会安全构成重大威胁。现有主动取证方法通常将深度伪造检测、篡改定位和源追溯视为独立任务,缺乏统一框架。为此,我们提出一种统一的主动取证框架,联合解决这三个核心任务。核心是创新的152维地标-身份水印(LIDMark),将面部关键点与唯一源标识结构化融合。为鲁棒提取LIDMark,设计新型分因子头解码器(FHD),其架构将共享主干特征分解为回归与分类两个专用头,分别鲁棒重建嵌入的地标与标识,即使在严重失真或篡改下亦可保持有效性。该设计实现“一体化”三功能取证:回归头基于内在-外在一致性检查完成检测与定位,分类头则可靠解码源标识用于追溯。大量实验表明,所提LIDMark框架为深度伪造内容的检测、定位与溯源提供了一种统一、鲁棒且不可感知的解决方案。代码已开源:https://github.com/vpsg-research/LIDMark。
原文摘要 · Abstract (English)
With the rapid advancement of deepfake technology, malicious face manipulations pose a significant threat to personal privacy and social security. However, existing proactive forensics methods typically treat deepfake detection, tampering localization, and source tracing as independent tasks, lacking a unified framework to address them jointly. To bridge this gap, we propose a unified proactive forensics framework that jointly addresses these three core tasks. Our core framework adopts an innovative 152-dimensional landmark-identity watermark termed LIDMark, which structurally interweaves facial landmarks with a unique source identifier. To robustly extract the LIDMark, we design a novel Factorized-Head Decoder (FHD). Its architecture factorizes the shared backbone features into two specialized heads (i.e., regression and classification), robustly reconstructing the embedded landmarks and identifier, respectively, even when subjected to severe distortion or tampering. This design realizes an "all-in-one" trifunctional forensic solution: the regression head underlies an "intrinsic-extrinsic" consistency check for detection and localization, while the classification head robustly decodes the source identifier for tracing. Extensive experiments show that the proposed LIDMark framework provides a unified, robust, and imperceptible solution for the detection, localization, and tracing of deepfake content. The code is available at https://github.com/vpsg-research/LIDMark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。