无需配对图像即可定位伪造痕迹,提升检测可解释性。
Learning to Discover Forgery Cues for Face Forgery Detection
- 弱监督学习定位未配对人脸中的伪造线索
- 生成更准确的篡改图谱,提升检测模型性能
- 适合需要可解释性的伪造检测场景
定位篡改图谱(即像素级伪造线索标注)对于实现可解释的面部伪造检测至关重要。现有方法通常将此类定位作为辅助任务以提升分类性能,但需依赖成对的真实与伪造人脸进行监督,限制了其在无配对场景下的应用,并违背真实使用情境。此外,现有比较方法会标注所有变化像素,包括压缩和上采样引入的噪声,导致模型难以学习有效线索,易过拟合。为此,本文提出一种弱监督模型 Forgery Cue Discovery (FoCus),可在无配对图像条件下定位伪造线索。不同于仅依赖注意力图定位伪造区域的检测器,FoCus通过分类注意力区域提议模块和互补学习模块,避免捕捉部分或不准确的伪造线索。生成的篡改图谱可作为更优监督信号,提升伪造检测器性能。在五个数据集及四类多任务模型上的实验表明,FoCus在跨数据集与同数据集评估中均具有效性。
原文摘要 · Abstract (English)
Locating manipulation maps, i.e., pixel-level annotation of forgery cues, is crucial for providing interpretable detection results in face forgery detection. Related learning objects have also been widely adopted as auxiliary tasks to improve the classification performance of detectors whereas they require comparisons between paired real and forged faces to obtain manipulation maps as supervision. This requirement restricts their applicability to unpaired faces and contradicts real-world scenarios. Moreover, the used comparison methods annotate all changed pixels, including noise introduced by compression and upsampling. Using such maps as supervision hinders the learning of exploitable cues and makes models prone to overfitting. To address these issues, we introduce a weakly supervised model in this paper, named Forgery Cue Discovery (FoCus), to locate forgery cues in unpaired faces. Unlike some detectors that claim to locate forged regions in attention maps, FoCus is designed to sidestep their shortcomings of capturing partial and inaccurate forgery cues. Specifically, we propose a classification attentive regions proposal module to locate forgery cues during classification and a complementary learning module to facilitate the learning of richer cues. The produced manipulation maps can serve as better supervision to enhance face forgery detectors. Visualization of the manipulation maps of the proposed FoCus exhibits superior interpretability and robustness compared to existing methods. Experiments on five datasets and four multi-task models demonstrate the effectiveness of FoCus in both in-dataset and cross-dataset evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。