测试了AI生成图像的检测能力,发现识别来源模型仍很困难。
Findings of the Counter Turing Test: AI-Generated Image Detection

- 用多种AI模型生成图像,构建了9.6万张真实与合成图像数据集
- 检测真假图像准确率超83%,但识别具体生成模型最高仅49.86%
- 适合关注生成内容安全、检测技术的研究者和从业者
生成式AI技术(如Stable Diffusion、DALL-E、Midjourney)快速发展,极大推动了合成视觉内容的创造,但也带来了虚假信息、误导性内容和偏见生成等挑战。随着AI生成图像日益逼真,其检测成为研究界、政策制定者和产业界亟需解决的问题。本文报告了Defactify 4.0研讨会中开展的对抗图灵测试(CT2)的成果,该测试包含两项任务:(1)二分类判断图像是否为AI生成;(2)识别具体生成模型。为此我们使用了MS COCOAI数据集,包含96000张由五种前沿生成模型产生的合成图像及来自MS COCO的真实图像。参赛者采用了卷积神经网络(CNN)、视觉变换器(ViT)、频域分析、对比学习和多模态方法等多种策略。结果显示,图像真假检测的F1分数超过0.83,但识别具体生成模型仍具挑战,最高F1分数为0.4986。研究强调了改进模型指纹、对抗鲁棒性和实时检测机制的必要性。
原文摘要 · Abstract (English)
The rapid advancements in generative AI technologies, such as Stable Diffusion, DALL-E, and Midjourney, have significantly transformed the creation of synthetic visual content. While these models enable innovation across industries, they also pose serious challenges, including misinformation, disinformation, and biased content generation. The increasing realism of AI-generated images makes their detection a pressing concern for researchers, policymakers, and industry stakeholders. In this paper, we present the findings of the Defactify 4.0 workshop, which introduced the Counter Turing Test (CT2) for AI-Generated Image Detection. The competition consisted of two key tasks: (1) binary classification of images as either AI-generated or real and (2) identification of the specific generative model responsible for an AI-generated image. To support both tasks, we employed the MS COCOAI dataset, a benchmark of 96000 real and synthetic images generated by five state-of-the-art models alongside real images from MS COCO. Participants employed diverse detection strategies, including convolutional neural networks (CNNs), Vision Transformers (ViTs), frequency-based analysis, contrastive learning, and multimodal techniques. The results demonstrated that while AI-generated images can be detected with high accuracy (F1-score > 0.83), identifying the exact model used remains significantly more challenging (highest F1-score: 0.4986). These findings highlight the need for improved model fingerprinting, adversarial robustness, and real-time detection mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。