通过渐进式伪造增强提升检测器泛化能力。
Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection

- 设计动态伪造增强策略,按课程逐步引入复杂伪造。
- 在跨数据集和跨方法测试中显著提升检测效果。
- 适合需要强泛化能力的深度伪造检测场景。
先前的深度伪造检测研究在测试与训练数据同源时表现良好,但在面对未见数据集或未见生成方法的伪造图像时仍具挑战性。本文提出一种新型通用深度伪造检测方法——课程动态伪造增强(CDFA),联合训练深度伪造检测器与伪造增强策略网络。不同于以往工作,我们提出在训练过程中遵循单调课程逐步应用伪造增强。进一步设计动态伪造搜索策略,根据训练阶段为每张图像选择合适的伪造增强操作,从而生成优化的伪造增强策略以提升泛化性能。此外,提出一种名为自移位混合图像的新伪造增强方法,用于简单模拟深度伪造生成中的时间不一致性。大量实验证明,CDFA能以即插即用方式显著提升多种基础检测器在跨数据集和跨操纵方法场景下的性能,并在多个基准数据集上超越现有方法。
原文摘要 · Abstract (English)
Previous studies in deepfake detection have shown promising results when testing face forgeries from the same dataset as the training. However, the problem remains challenging when one tries to generalize the detector to forgeries from unseen datasets and created by unseen methods. In this work, we present a novel general deepfake detection method, called \textbf{C}urricular \textbf{D}ynamic \textbf{F}orgery \textbf{A}ugmentation (CDFA), which jointly trains a deepfake detector with a forgery augmentation policy network. Unlike the previous works, we propose to progressively apply forgery augmentations following a monotonic curriculum during the training. We further propose a dynamic forgery searching strategy to select one suitable forgery augmentation operation for each image varying between training stages, producing a forgery augmentation policy optimized for better generalization. In addition, we propose a novel forgery augmentation named self-shifted blending image to simply imitate the temporal inconsistency of deepfake generation. Comprehensive experiments show that CDFA can significantly improve both cross-datasets and cross-manipulations performances of various naive deepfake detectors in a plug-and-play way, and make them attain superior performances over the existing methods in several benchmark datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。