利用生成模型判别器提取通用伪造特征,提升跨模型深伪检测能力
CIPHER: Counterfeit Image Pattern High-level Examination via Representation
- 复用生成模型判别器,提取尺度自适应与时间一致性特征
- 在9个生成模型上达74.33% F1,平均超越ViT检测器30%以上
- 在挑战性数据集CIFAKE上达88% F1,适合应对快速演进的生成技术
生成对抗网络(GANs)和扩散模型的快速发展使得合成人脸图像愈发逼真,难以与真实图像区分。这加剧了虚假信息、欺诈和身份滥用的风险,迫切需要能抵御多种生成模型的鲁棒检测器。本文提出一种名为CIPHER的深度伪造检测框架,通过系统性复用并微调原本用于图像生成的判别器,从ProGAN判别器中提取尺度自适应特征,从扩散模型中提取时间一致性特征,捕捉传统检测器常忽略的生成无关伪造痕迹。在九种前沿生成模型上的广泛实验表明,CIPHER具备卓越的跨模型检测性能,最高达74.33% F1分数,平均优于现有ViT-based检测器超过30%。尤其在基准方法失效的挑战性数据集CIFAKE上,其表现高达88% F1,而传统检测器接近零分。这些结果验证了判别器复用与跨模型微调的有效性,为构建更通用、更鲁棒的深伪检测系统提供了新路径。
原文摘要 · Abstract (English)
The rapid progress of generative adversarial networks (GANs) and diffusion models has enabled the creation of synthetic faces that are increasingly difficult to distinguish from real images. This progress, however, has also amplified the risks of misinformation, fraud, and identity abuse, underscoring the urgent need for detectors that remain robust across diverse generative models. In this work, we introduce Counterfeit Image Pattern High-level Examination via Representation(CIPHER), a deepfake detection framework that systematically reuses and fine-tunes discriminators originally trained for image generation. By extracting scale-adaptive features from ProGAN discriminators and temporal-consistency features from diffusion models, CIPHER captures generation-agnostic artifacts that conventional detectors often overlook. Through extensive experiments across nine state-of-the-art generative models, CIPHER demonstrates superior cross-model detection performance, achieving up to 74.33% F1-score and outperforming existing ViT-based detectors by over 30% in F1-score on average. Notably, our approach maintains robust performance on challenging datasets where baseline methods fail, with up to 88% F1-score on CIFAKE compared to near-zero performance from conventional detectors. These results validate the effectiveness of discriminator reuse and cross-model fine-tuning, establishing CIPHER as a promising approach toward building more generalizable and robust deepfake detection systems in an era of rapidly evolving generative technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。