arXiv:2504.20865cs.CV2025-04中稿 · Verimedia workshop…被引 13

构建动态基准,测试图像检测模型对新型生成工具的泛化能力。

AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection

  • 按生成模型时间顺序逐步训练检测器,模拟真实演进场景。
  • 覆盖高质量多样图像,支持跨模型泛化能力评估。
  • 面向研究者与记者等非专家,提供易用工具与可复现方案。

生成式AI的快速发展重塑了图像创作方式,使文本生成高质量图像成为可能,但同时也带来了媒体真实性的严峻挑战。本文提出Ai-GenBench,一个新型基准,旨在应对真实场景中对AI生成图像检测的迫切需求。不同于现有静态数据集评估方式,Ai-GenBench引入时间维度评估框架,让检测方法在按生成模型历史顺序排列的合成图像上逐步训练,以检验其对新生成模型(如从GAN过渡到扩散模型)的泛化能力。该基准聚焦高质量、多样化的视觉内容,克服了当前方法中存在的任意数据划分、不公平比较和过高计算开销等关键缺陷。Ai-GenBench提供全面数据集、标准化评估协议及面向研究人员和非专业人士(如记者、事实核查员)的可访问工具,确保可复现性的同时维持实际训练可行性。通过建立明确评估规则与受控增强策略,该基准支持检测方法的有意义对比与可扩展解决方案。代码与数据公开,以推动鲁棒取证检测器的发展,紧跟新型合成生成器的演进步伐。

原文摘要 · Abstract (English)

The rapid advancement of generative AI has revolutionized image creation, enabling high-quality synthesis from text prompts while raising critical challenges for media authenticity. We present Ai-GenBench, a novel benchmark designed to address the urgent need for robust detection of AI-generated images in real-world scenarios. Unlike existing solutions that evaluate models on static datasets, Ai-GenBench introduces a temporal evaluation framework where detection methods are incrementally trained on synthetic images, historically ordered by their generative models, to test their ability to generalize to new generative models, such as the transition from GANs to diffusion models. Our benchmark focuses on high-quality, diverse visual content and overcomes key limitations of current approaches, including arbitrary dataset splits, unfair comparisons, and excessive computational demands. Ai-GenBench provides a comprehensive dataset, a standardized evaluation protocol, and accessible tools for both researchers and non-experts (e.g., journalists, fact-checkers), ensuring reproducibility while maintaining practical training requirements. By establishing clear evaluation rules and controlled augmentation strategies, Ai-GenBench enables meaningful comparison of detection methods and scalable solutions. Code and data are publicly available to ensure reproducibility and to support the development of robust forensic detectors to keep pace with the rise of new synthetic generators.

图像检测生成对抗真实性验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。