人类难辨AI生成图片，准确率仅略高于随机猜测。
We are not able to identify AI-generated images
- 设计在线实验让用户区分真实与AI生成图像
- 平均准确率54%，远未达可靠水平
- 适合关注AI伦理与媒体可信度的读者
AI生成图像已广泛存在于网络，但许多人认为能轻易分辨其真伪。我们通过互动网页实验测试这一假设，要求参与者判断20张图像是否为AI生成。数据集包含120个高难度案例：来自CC12M的真实图像及用MidJourney精心生成的对应图像。共165名用户完成233次实验，平均准确率为54%，仅略高于随机猜测，且重复尝试后改善有限。响应时间平均7.3秒，部分图像更易误导。结果表明，即使在相对简单的肖像图像上，人类也难以可靠识别AI生成内容。随着合成媒体持续进步，仅靠人类判断已不足以区分真实与虚假数据。研究强调需提高公众意识并制定相应伦理规范。
原文摘要 · Abstract (English)
AI-generated images are now pervasive online, yet many people believe they can easily tell them apart from real photographs. We test this assumption through an interactive web experiment where participants classify 20 images as real or AI-generated. Our dataset contains 120 difficult cases: real images sampled from CC12M, and carefully curated AI-generated counterparts produced with MidJourney. In total, 165 users completed 233 sessions. Their average accuracy was 54%, only slightly above random guessing, with limited improvement across repeated attempts. Response times averaged 7.3 seconds, and some images were consistently more deceptive than others. These results indicate that, even on relatively simple portrait images, humans struggle to reliably detect AI-generated content. As synthetic media continues to improve, human judgment alone is becoming insufficient for distinguishing real from artificial data. These findings highlight the need for greater awareness and ethical guidelines as AI-generated media becomes increasingly indistinguishable from reality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。