构建新基准,揭示图像篡改检测模型在真实场景下的脆弱性
NeXT-IMDL: Build Benchmark for NeXT-Generation Image Manipulation Detection & Localization
- 按编辑模型、篡改类型等四维度设计诊断评测框架
- 11个主流模型在跨维度测试中性能普遍大幅下降
- 适合关注AI伪造检测鲁棒性的研究人员和开发者
用户友好的图像编辑模型普及带来滥用风险,亟需可泛化的下一代图像篡改检测与定位(IMDL)方法。当前研究多采用跨数据集评估,但该方法掩盖了现有模型在应对多样化AI生成内容时的脆弱性,造成进展假象。本文提出NeXT-IMDL——一个大规模诊断基准,不仅收集数据,更系统探查现有检测器的泛化边界。该基准从编辑模型、篡改类型、内容语义、伪造粒度四个核心维度对AIGC篡改进行分类,并设计五种严格的跨维度评估协议。对11个代表性模型的实验表明:尽管这些模型在原始设置下表现良好,但在模拟真实世界多样泛化场景的评测中出现系统性失效,性能显著下降。本工作通过提供诊断工具与新发现,推动构建真正鲁棒的下一代IMDL模型。
原文摘要 · Abstract (English)
The accessibility surge and abuse risks of user-friendly image editing models have created an urgent need for generalizable, up-to-date methods for Image Manipulation Detection and Localization (IMDL). Current IMDL research typically uses cross-dataset evaluation, where models trained on one benchmark are tested on others. However, this simplified evaluation approach conceals the fragility of existing methods when handling diverse AI-generated content, leading to misleading impressions of progress. This paper challenges this illusion by proposing NeXT-IMDL, a large-scale diagnostic benchmark designed not just to collect data, but to probe the generalization boundaries of current detectors systematically. Specifically, NeXT-IMDL categorizes AIGC-based manipulations along four fundamental axes: editing models, manipulation types, content semantics, and forgery granularity. Built upon this, NeXT-IMDL implements five rigorous cross-dimension evaluation protocols. Our extensive experiments on 11 representative models reveal a critical insight: while these models perform well in their original settings, they exhibit systemic failures and significant performance degradation when evaluated under our designed protocols that simulate real-world, various generalization scenarios. By providing this diagnostic toolkit and the new findings, we aim to advance the development towards building truly robust, next-generation IMDL models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。