arXiv:2511.02791cs.CVcs.GT2025-11被引 7

建立统一基准评估AI图像伪造检测方法,揭示现有技术泛化能力差异。

AI-Generated Image Detection: An Empirical Study and Future Research Directions

  • 构建标准化框架,统一评估生成模型与训练方式下的检测性能。
  • 十种主流方法在跨模型迁移中表现波动大,部分仅限特定生成器有效。
  • 引入可解释性分析,助力理解检测机制并推动可信系统研发。

AI生成媒体(尤其是深度伪造)正对多媒体取证、虚假信息识别和生物特征系统构成严峻挑战,导致公众对司法体系信任下降、欺诈案件激增及社会工程攻击频发。尽管已有多种取证方法提出,但存在三大缺陷:(i) 基准不统一,使用GAN或扩散模型生成图像;(ii) 训练协议不一致(如从零训练、冻结、微调);(iii) 评估指标有限,无法捕捉泛化能力和可解释性。这些限制阻碍了公平比较,掩盖真实鲁棒性,制约在安全关键场景部署。本文提出一个统一的基准评估框架,在受控且可复现条件下系统评估当前先进方法。我们对十种SOTA检测方法(不同训练策略)和七个公开数据集(包含GAN与扩散模型生成图像)进行大规模系统评估,采用准确率、平均精度、ROC-AUC、错误率及类别敏感度等多指标。同时通过置信度曲线与Grad-CAM热力图分析模型可解释性。结果表明,泛化性能存在显著差异,某些方法在分布内表现优异,但在跨模型迁移中明显退化。本研究旨在引导学界深入理解现有方法的优劣,推动更鲁棒、泛化性强且可解释的解决方案发展。

原文摘要 · Abstract (English)

The threats posed by AI-generated media, particularly deepfakes, are now raising significant challenges for multimedia forensics, misinformation detection, and biometric system resulting in erosion of public trust in the legal system, significant increase in frauds, and social engineering attacks. Although several forensic methods have been proposed, they suffer from three critical gaps: (i) use of non-standardized benchmarks with GAN- or diffusion-generated images, (ii) inconsistent training protocols (e.g., scratch, frozen, fine-tuning), and (iii) limited evaluation metrics that fail to capture generalization and explainability. These limitations hinder fair comparison, obscure true robustness, and restrict deployment in security-critical applications. This paper introduces a unified benchmarking framework for systematic evaluation of forensic methods under controlled and reproducible conditions. We benchmark ten SoTA forensic methods (scratch, frozen, and fine-tuned) and seven publicly available datasets (GAN and diffusion) to perform extensive and systematic evaluations. We evaluate performance using multiple metrics, including accuracy, average precision, ROC-AUC, error rate, and class-wise sensitivity. We also further analyze model interpretability using confidence curves and Grad-CAM heatmaps. Our evaluations demonstrate substantial variability in generalization, with certain methods exhibiting strong in-distribution performance but degraded cross-model transferability. This study aims to guide the research community toward a deeper understanding of the strengths and limitations of current forensic approaches, and to inspire the development of more robust, generalizable, and explainable solutions.

图像伪造检测可解释性基准评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。