arXiv:2607.18230cs.CVcs.AI2026-07

提升视觉语言模型生成图像篡改检测的跨域鲁棒性

Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs

论文配图:Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs
图 1 · 摘自论文原文
  • 采用均衡采样与后期注入策略,避免模型偏向真实或篡改图像
  • 在GPT-Images-2.0等新模型上相比SOTA提升26.1%平均gIoU
  • 方法简单有效,适合快速部署到新型生成模型的检测任务

现代视觉语言模型(如ChatGPT、Gemini、Qwen-Image)的图像生成与编辑能力显著增强,使得像素级图像篡改检测在跨模型和分布外场景下愈发重要且具挑战性。本文研究了在现代VLM中实现像素级篡改检测的领域泛化问题,目标是训练出对多样化VLM生成篡改分布均鲁棒的定位模型。提出一种简单而有效的领域泛化训练框架,包含两项实用策略:一是采用平衡小批量采样,确保每个训练步同时包含真实与篡改图像,防止优化偏差与训练崩溃;二是采用简单后期注入策略,先在大规模基础数据上训练稳定,再用少量新兴VLM数据微调,提升适应性且不过拟合。该框架在GPT-Images-2.0、Gemini-3.1、FLUX.2和Seedream 4.5等分布外模型上,平均gIoU和cIoU分别较现有最佳方法PIXAR提升26.1%和26.8%,验证了其有效性。代码已开源。

原文摘要 · Abstract (English)

Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG

图像检测领域泛化视觉语言模型篡改识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。