arXiv:2411.05335cs.CVcs.CR2024-11被引 9

通过关注伪造质量提升检测模型泛化能力,让算法更懂难辨的深伪图像。

A Quality-Centric Framework for Generic Deepfake Detection

  • 按伪造质量分级训练样本,从简单到复杂逐步学习
  • 引入新型数据增强,让低质量伪造图更逼真
  • 可无缝接入现有检测模型,适合追求泛化的研究者

检测AI生成图像(尤其是深伪)日益重要,核心挑战在于对未见过的篡改方法具备泛化能力。本文提出一种以伪造质量为核心的通用深伪检测框架,旨在通过训练数据的伪造质量来提升检测器泛化性能。不同深伪图像的伪造质量差异显著:部分存在明显破绽,而另一些则高度逼真。现有方法通常混合训练各类质量的深伪图像,可能导致检测器仅依赖易识别的低质量特征,从而损害泛化效果。为此,我们设计一个包含质量评估器、低质量数据增强模块和学习进度控制策略的框架。该框架受课程学习启发,循序渐进地引导检测器从易到难学习样本。采用静态与动态双重评估方式,结合评分生成每张训练样本的质量等级,高等级样本被更高概率选中。此外,提出一种针对低质量伪造样本的频率增强方法,有效削弱明显伪造痕迹,提升整体真实感。大量实验表明,该框架可即插即用,显著提升现有检测模型的泛化性能。

原文摘要 · Abstract (English)

Detecting AI-generated images, particularly deepfakes, has become increasingly crucial, with the primary challenge being the generalization to previously unseen manipulation methods. This paper tackles this issue by leveraging the forgery quality of training data to improve the generalization performance of existing deepfake detectors. Generally, the forgery quality of different deepfakes varies: some have easily recognizable forgery clues, while others are highly realistic. Existing works often train detectors on a mix of deepfakes with varying forgery qualities, potentially leading detectors to short-cut the easy-to-spot artifacts from low-quality forgery samples, thereby hurting generalization performance. To tackle this issue, we propose a novel quality-centric framework for generic deepfake detection, which is composed of a Quality Evaluator, a low-quality data enhancement module, and a learning pacing strategy that explicitly incorporates forgery quality into the training process. Our framework is inspired by curriculum learning, which is designed to gradually enable the detector to learn more challenging deepfake samples, starting with easier samples and progressing to more realistic ones. We employ both static and dynamic assessments to assess the forgery quality, combining their scores to produce a final rating for each training sample. The rating score guides the selection of deepfake samples for training, with higher-rated samples having a higher probability of being chosen. Furthermore, we propose a novel frequency data augmentation method specifically designed for low-quality forgery samples, which helps to reduce obvious forgery traces and improve their overall realism. Extensive experiments demonstrate that our proposed framework can be applied plug-and-play to existing detection models and significantly enhance their generalization performance in detection.

深伪检测质量评估泛化能力课程学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。