提出AIGIBench基准,检验AI生成图像检测在真实场景下的可靠性。
Is Artificial Intelligence Generated Image Detection a Solved Problem?
- 构建四类真实挑战任务评估检测器泛化能力
- 11个主流检测器在真实数据上性能显著下降
- 适合关注生成内容安全与检测鲁棒性的研究者
生成模型(如GANs和扩散模型)的快速发展使合成图像日益逼真,引发虚假信息、深度伪造和版权侵权等担忧。尽管已有众多AI生成图像(AIGI)检测方法声称高准确率,但其在真实场景中的有效性仍存疑。为此,本文提出AIGIBench,一个全面的评估基准,用于严格测试先进AIGI检测器的鲁棒性与泛化能力。该基准通过四个核心任务模拟真实挑战:多源泛化、图像退化鲁棒性、数据增强敏感性以及测试时预处理影响。包含23个多样化的假图子集,覆盖先进与广泛使用的生成技术,并整合社交媒体及AI艺术平台的真实样本。对11个先进检测器的实验表明,尽管在受控环境中表现优异,它们在真实数据上性能大幅下降,常规增强带来有限收益,预处理影响复杂微妙,凸显亟需更稳健的检测策略。AIGIBench为未来研究提供统一、真实的评估框架。数据与代码公开于:https://github.com/HorizonTEL/AIGIBench。
原文摘要 · Abstract (English)
The rapid advancement of generative models, such as GANs and Diffusion models, has enabled the creation of highly realistic synthetic images, raising serious concerns about misinformation, deepfakes, and copyright infringement. Although numerous Artificial Intelligence Generated Image (AIGI) detectors have been proposed, often reporting high accuracy, their effectiveness in real-world scenarios remains questionable. To bridge this gap, we introduce AIGIBench, a comprehensive benchmark designed to rigorously evaluate the robustness and generalization capabilities of state-of-the-art AIGI detectors. AIGIBench simulates real-world challenges through four core tasks: multi-source generalization, robustness to image degradation, sensitivity to data augmentation, and impact of test-time pre-processing. It includes 23 diverse fake image subsets that span both advanced and widely adopted image generation techniques, along with real-world samples collected from social media and AI art platforms. Extensive experiments on 11 advanced detectors demonstrate that, despite their high reported accuracy in controlled settings, these detectors suffer significant performance drops on real-world data, limited benefits from common augmentations, and nuanced effects of pre-processing, highlighting the need for more robust detection strategies. By providing a unified and realistic evaluation framework, AIGIBench offers valuable insights to guide future research toward dependable and generalizable AIGI detection.Data and code are publicly available at: https://github.com/HorizonTEL/AIGIBench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。