新数据集TGIF2揭示AI绘图伪造的检测盲区
TGIF2: Extended Text-Guided Inpainting Forgery Dataset & Benchmark

- 用FLUX.1模型生成新伪造图像,覆盖完整重绘场景
- 发现现有检测方法在真实重绘图像上准确率下降超40%
- 适合图像取证研究者和生成式AI安全评估人员
生成式AI使文本引导修复成为强大图像编辑工具,但也给媒体鉴伪带来挑战。现有基准(包括我们先前的TGIF数据集)显示,图像伪造定位(IFL)方法可识别拼接伪造,但难以定位完全重绘(FR)图像;而合成图像检测(SID)方法虽能检测完全重绘图像,却无法定位。随着新生成式修复模型不断涌现,且FR图像定位问题仍未解决,亟需更新数据集与基准。本文推出TGIF2,扩展了原数据集,引入由FLUX.1模型生成的篡改图像及随机非语义掩码。基于TGIF2,我们开展了涵盖IFL与SID的鉴伪评估,包括在FR图像上微调IFL方法及生成式超分辨率攻击实验。结果表明,二者在FLUX.1篡改下性能均显著下降,暴露泛化能力不足。尽管微调提升了对FR图像的定位能力,但随机非语义掩码测试揭示对象偏见。此外,生成式超分辨率显著削弱鉴伪痕迹,说明常见图像增强操作会破坏现有鉴伪流程。TGIF2为现代修复与AI增强带来的挑战提供了新洞察。数据集已开源:https://github.com/IDLabMedia/tgif-dataset。
原文摘要 · Abstract (English)
Generative AI has made text-guided inpainting a powerful image editing tool, but at the same time a growing challenge for media forensics. Existing benchmarks, including our text-guided inpainting forgery (TGIF) dataset, show that image forgery localization (IFL) methods can localize manipulations in spliced images but struggle not in fully regenerated (FR) images, while synthetic image detection (SID) methods can detect fully regenerated images but cannot perform localization. With new generative inpainting models emerging and the open problem of localization in FR images remaining, updated datasets and benchmarks are needed. We introduce TGIF2, an extended version of TGIF, that captures recent advances in text-guided inpainting and enables a deeper analysis of forensic robustness. TGIF2 augments the original dataset with edits generated by FLUX.1 models, as well as with random non-semantic masks. Using the TGIF2 dataset, we conduct a forensic evaluation spanning IFL and SID, including fine-tuning IFL methods on FR images and generative super-resolution attacks. Our experiments show that both IFL and SID methods degrade on FLUX.1 manipulations, highlighting limited generalization. Additionally, while fine-tuning improves localization on FR images, evaluation with random non-semantic masks reveals object bias. Furthermore, generative super-resolution significantly weakens forensic traces, demonstrating that common image enhancement operations can undermine current forensic pipelines. In summary, TGIF2 provides an updated dataset and benchmark, which enables new insights into the challenges posed by modern inpainting and AI-based image enhancements. TGIF2 is available at https://github.com/IDLabMedia/tgif-dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。