构建可解释的AI生成图像语义异常检测基准,提升内容可信度评估
Semantic Visual Anomaly Detection and Reasoning in AI-Generated Images
- 提出多智能体管道AnomAgent,自动标注图像语义异常四元组
- 在41.7亿次GPT-4o调用基础上构建大规模高质量数据集
- 支持深度伪造可解释检测与生成器合理性评估,适合安全与可信研究
AI生成内容(AIGC)快速发展,虽能合成视觉逼真的图像,但常存在物体配置不合理、违反物理规律或常识等细微语义异常,影响生成场景的整体可信度。本文正式提出AIGC图像的语义异常检测与推理任务,引入名为AnomReason的大规模基准数据集,采用结构化四元组(名称、现象、推理、严重性)进行标注。通过轻量级人机协同的多智能体管道AnomAgent完成标注,共处理约41.7亿个GPT-4o token,保障规模与质量。基于该数据集微调的模型,在新提出的语义匹配指标(SemAP和SemF1)下优于强视觉语言基线。应用证明其在可解释深度伪造检测和图像生成器合理性评估中具有实用价值。我们公开代码、指标、数据及对齐任务的模型,推动语义真实性与可解释AIGC取证研究。
原文摘要 · Abstract (English)
The rapid advancement of AI-generated content (AIGC) has enabled the synthesis of visually convincing images; however, many such outputs exhibit subtle \textbf{semantic anomalies}, including unrealistic object configurations, violations of physical laws, or commonsense inconsistencies, which compromise the overall plausibility of the generated scenes. Detecting these semantic-level anomalies is essential for assessing the trustworthiness of AIGC media, especially in AIGC image analysis, explainable deepfake detection and semantic authenticity assessment. In this paper, we formalize \textbf{semantic anomaly detection and reasoning} for AIGC images and introduce \textbf{AnomReason}, a large-scale benchmark with structured annotations as quadruples \emph{(Name, Phenomenon, Reasoning, Severity)}. Annotations are produced by a modular multi-agent pipeline (\textbf{AnomAgent}) with lightweight human-in-the-loop verification, enabling scale while preserving quality. At construction time, AnomAgent processed approximately 4.17\,B GPT-4o tokens, providing scale evidence for the resulting structured annotations. We further show that models fine-tuned on AnomReason achieve consistent gains over strong vision-language baselines under our proposed semantic matching metric (\textit{SemAP} and \textit{SemF1}). Applications to {explainable deepfake detection} and {semantic reasonableness assessment of image generators} demonstrate practical utility. In summary, AnomReason and AnomAgent serve as a foundation for measuring and improving the semantic plausibility of AI-generated images. We will release code, metrics, data, and task-aligned models to support reproducible research on semantic authenticity and interpretable AIGC forensics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。