构建首个针对多模态大模型生成图像的检测基准数据集,揭示现有检测方法的失效问题。
A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana2

- 设计三类生成协议模拟真实场景下的图像生成方式。
- 实测发现现有检测器在高质量生成图像上误检率显著上升。
- 提出SAP-DSP框架,通过双流提示学习提升检测稳定性。
近年来,多模态大语言模型(如GPT Image2和Nano Banana2)生成图像的真实感迅速提升,尤其在文本渲染方面取得明显进步,能够生成高度贴近现实应用场景的高质量图像。这种生成能力的增强对AI生成图像检测提出了更严峻挑战:检测不再仅依赖早期生成模型留下的明显痕迹,而需面对系统性、高保真的新型伪造内容。然而,现有大多数基准仍基于早期生成模型,难以评估当前高保真多形式生成图像带来的取证难题。为此,本文构建了一个面向多模态大模型生成图像的检测基准数据集,涵盖多种真实应用情景,并采用三种生成协议(直接生成、参考重建、局部编辑)进行数据构造。基于该数据集,我们评估了传统检测方法从经典场景到MLLM生成图像时的性能退化情况,分析了三类样本的误报率与漏报率,揭示了现有方法的失效模式。进一步提出结构-伪影先验引导的双流提示框架(SAP-DSP),通过双流提示学习与结构感知融合机制增强表征能力。大量实验表明,该基准暴露了现有检测器在高质量生成图像上的性能下降,而SAP-DSP在该基准上实现了更稳定的检测效果。代码与数据集已公开于https://github.com/xbrainnet/SAP-DSP。
原文摘要 · Abstract (English)
The realism of images generated by multimodal large language models (MLLMs), such as GPT Image2 and Nano Banana2, has improved rapidly in recent years. Compared with early generative models, current models have made clear progress in text rendering. They can produce high-quality images that closely resemble real-world application scenarios. The enhanced generation capabilities of current MLLMs pose increasingly severe challenges to AI-generated image detection. Detection is no longer limited to identifying obvious artifacts left by early generators. Instead, it requires systematic and realistic benchmarks for the new generation of generated content. However, most existing benchmarks are still built around early generative models and cannot fully evaluate the forensic challenges introduced by high-quality and multi-form generated images. To address this gap, this paper constructs a benchmark dataset for detecting images generated by MLLMs. The benchmark covers several realistic application scenarios and adopts three generation protocols to simulate direct generation, reference-based reconstruction, and local editing. Based on this benchmark, we evaluate detector degradation from traditional scenarios to MLLM-generated images and analyze false positive rates and false negative rates across three sample types, revealing the failure modes of existing methods. We further propose a structural-artifact-prior-guided dual-stream prompt framework (SAP-DSP) as a strong baseline. SAP-DSP uses dual-stream prompt learning and structure-aware routing fusion to improve representation learning. Extensive experiments show that the proposed benchmark exposes the performance degradation of existing detectors on high-quality generated images, while SAP-DSP achieves more stable detection results on this benchmark. Our code and dataset are publicly available at https://github.com/xbrainnet/SAP-DSP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。