arXiv:2604.08211cs.CV2026-04被引 3

首个针对AI生成科学图表的检测基准,揭示现有方法在真实场景下严重失效。

SciFigDetect: A Benchmark for AI-Generated Scientific Figure Detection

  • 构建基于智能体的数据流水线,生成结构化、语义对齐的合成图表数据
  • 零样本迁移测试中当前方法准确率不足30%,跨生成器泛化能力极差
  • 适合从事学术诚信、图像取证与多模态生成安全的研究者使用

现代多模态生成模型已能产出接近发表水平的科学图表,对视觉取证和科研诚信构成新挑战。与常规生成自然图像不同,科学图表具有结构化、文本密集且与学术语义高度对齐的特点,是独特而难检测的目标。然而,现有检测基准和方法几乎全针对开放域图像,此领域仍基本空白。本文提出首个AI生成科学图表检测基准。通过构建基于智能体的数据流水线,从授权论文中检索源文献,结合多模态理解文图内容,生成结构化提示,合成候选图表,并通过评审驱动的迭代优化过滤。最终数据集涵盖多种图表类型、多种生成源,并提供真实-合成配对样本。我们在零样本、跨生成器及退化图像设置下评估代表性检测器,结果表明:当前方法在零样本迁移中表现极差,存在显著生成器特异性过拟合,且对常见后处理篡改极为脆弱。这些发现揭示了现有AIGI检测能力与高质量科学图表分布之间的巨大差距。我们希望该基准能推动未来更鲁棒、泛化性强的科学图表取证研究。数据集已开源:https://github.com/Joyce-yoyo/SciFigDetect。

原文摘要 · Abstract (English)

Modern multimodal generators can now produce scientific figures at near-publishable quality, creating a new challenge for visual forensics and research integrity. Unlike conventional AI-generated natural images, scientific figures are structured, text-dense, and tightly aligned with scholarly semantics, making them a distinct and difficult detection target. However, existing AI-generated image detection benchmarks and methods are almost entirely developed for open-domain imagery, leaving this setting largely unexplored. We present the first benchmark for AI-generated scientific figure detection. To construct it, we develop an agent-based data pipeline that retrieves licensed source papers, performs multimodal understanding of paper text and figures, builds structured prompts, synthesizes candidate figures, and filters them through a review-driven refinement loop. The resulting benchmark covers multiple figure categories, multiple generation sources and aligned real--synthetic pairs. We benchmark representative detectors under zero-shot, cross-generator, and degraded-image settings. Results show that current methods fail dramatically in zero-shot transfer, exhibit strong generator-specific overfitting, and remain fragile under common post-processing corruptions. These findings reveal a substantial gap between existing AIGI detection capabilities and the emerging distribution of high-quality scientific figures. We hope this benchmark can serve as a foundation for future research on robust and generalizable scientific-figure forensics. The dataset is available at https://github.com/Joyce-yoyo/SciFigDetect.

科学图表图像取证AI生成基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。