arXiv:2606.28510cs.HCcs.AI2026-06

30分钟训练让分析师识别真假图像准确率提升9个百分点。

Generative AI Literacy Training Improves Intelligence Analysts' Discrimination of Real and AI-Generated Images

论文配图:Generative AI Literacy Training Improves Intelligence Analysts' Discrimination of Real and AI-Generated Images
图 1 · 摘自论文原文
  • 用30分钟专家培训,教分析师识别真实与生成图像的视觉模式。
  • 训练后对真实图像的识别准确率提升14.2个百分点,整体准确率达81%。
  • 适合需要快速提升判别能力的政府情报人员或信息审核团队。

随着社交媒体和网络平台中生成式人工智能图像的普及,区分真实图像与AI生成图像已成为信息生态系统的重大挑战。尽管人类表现优于随机猜测,但准确率仍难以满足实际需求。初步研究表明,视觉导向的训练可提升深度伪造检测能力,但无法改善对真实图像的识别。本文研究了2024年美国政府情报分析师参与的一次简短培训干预的有效性。通过平衡设计的被试内随机实验,向32名分析师展示不同姿态复杂度和场景背景的真实与AI生成图像,并在培训前后分别判断其真伪,共收集2544条图像级判断。结果显示,培训使总体准确率从72%提升9个百分点(95% CI: [2.7, 15.4]),其中真实图像识别准确率提升14.2个百分点(95% CI: [0.7, 27.7])。通过精心匹配的真实与生成图像对,揭示了训练对不同数字取证和生成式AI经验水平人群的影响差异,并确定了该培训最有效的图像内容类型。结果提供了因果证据,表明简短、结构化的培训能显著提升人类在多种真实与生成图像上的判断能力,为组织应对生成式视觉误导信息提供依据。

原文摘要 · Abstract (English)

Across social and online platforms, people are increasingly exposed to AI-generated images. As a consequence, the task of distinguishing AI-generated from authentic images is becoming a central challenge for information ecosystems. While humans perform better than chance, accuracy falls short of many operational needs. Initial evidence shows that visually oriented training can improve deepfake detection but does not improve participants' ability to identify real images as real. Here, we investigate the efficacy of a brief training intervention for intelligence analysts employed by the United States government in 2024. We conducted a counterbalanced within-subject randomized experiment in which we showed participants real and AI-generated images varying in pose complexity and scene context and asked them whether each image was real or AI-generated, both before and after an expert delivered a 30-minute training that pointed out patterns in seven real and 50 AI-generated images. We collected 2,544 image-level judgments from 32 intelligence analysts. We find training increased overall accuracy by 9 percentage points (95% CI: [2.7, 15.4]) from a baseline of 72%. We find the improvement is driven by a 14.2 percentage point increase in accuracy for real images (95% CI: [0.7, 27.7]). Through a careful experimental setup that curated matched pairs of real and AI-generated images across pose complexity categories, we reveal how these trainings influence people with different levels of digital forensics and generative AI experience and identify the kind of image-based content where this training intervention appears to be most effective. Ultimately, these results provide causal evidence that a brief, structured training can improve human judgment across a diverse array of real and AI-generated images, informing organizational responses to AI-generated visual misinformation.

AI识伪认知训练情报分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。