解决多人场景下伪造检测、定位与溯源难题,实现真假、谁假、谁被篡改的三重判断。
Whether, Which, and Whose: Solving the Triple Challenge of Deepfake Proactive Forensics in Multi-Face Scenarios
- 设计隔离身份溯源空间,让多张人脸的伪造信号互不干扰。
- 通过区域选择性监督损失,精准定位被篡改面部,提升识别精度。
- 适用于视频会议、群照等真实复杂场景,适合安全与可信系统研究者。
与单人脸伪造不同,复杂多人互动场景(如群像照片和多人会议)中的深度伪造更贴近真实威胁。现有主动取证方法虽表现良好,但严重依赖单人脸假设,难以有效应对复杂多人环境中的伪造检测、定位与来源追溯问题。本文提出专为多人场景设计的深度可溯源水印框架(DAWF),构建独立的身份归属空间,实现多个独立追踪信号在同一图像中共存并准确锚定至对应身份实例。关键在于提出选择性区域监督损失,抑制跨人脸干扰,引导解码器专注被篡改面部区域。DAWF统一实现图像级检测、实例级定位与身份级溯源,成功达成‘是否伪造、哪个脸被伪造、谁的身份被篡改’的三重取证目标。在具有挑战性的多人数据集上实验表明,该方法性能稳健,达到AUC 0.91、F1分数0.87、误报率BER 0.54%。代码已开源:https://github.com/vpsg-research/DAWF。
原文摘要 · Abstract (English)
Unlike single-face forgeries, deepfakes in complex multi-person interaction scenarios (such as group photos and multi-person meetings) more closely reflect real-world threats. Although existing proactive forensics solutions demonstrate good performance, they heavily rely on a "single-face" setting, making it difficult to effectively deal with the problems of deepfake detection, localization, and source tracing in complex multi-person environments. In this paper, we propose a Deep Attributable Watermarking Framework (DAWF) tailored to multi-face proactive forensics, which establishes an isolated identity attribution space. This spatial isolation ensures that multiple independent tracing signals can coexist within a single image and be successfully anchored to their respective identity instances. Crucially, we propose a selective regional supervision loss to suppress cross-face interference, guiding the decoder to focus exclusively on the manipulated facial regions. DAWF unifies image-level detection, instance-level localization, and identity-level source tracing, successfully achieving the "whether, which, and whose" forensic goals of determining whether an image is manipulated, which face is forged, and whose identity is tampered with. Extensive experiments on challenging multi-face datasets demonstrate robust triple-forensic performance, achieving an AUC of 0.91, an F1-score of 0.87, and a BER of 0.54%. The code is available at https://github.com/vpsg-research/DAWF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。