arXiv:2504.07462cs.CV2025-04被引 4

学习图像原始内容的通用特征,实现对未知伪造图像的定位

Learning Universal Features for Generalizable Image Forgery Localization

  • 从图像原始内容中提取跨类型伪造共有的通用特征
  • 在未见过的伪造图像上检测准确率显著优于现有方法
  • 适合需要应对生成式AI伪造的新一代检测系统开发者

近年来,先进的图像编辑与生成技术迅速发展,使得检测和定位伪造图像内容愈发困难。现有方法多依赖于识别图像中留下的特定编辑痕迹,但由于不同伪造方式的痕迹差异大,模型仅能识别训练数据中的已知伪造,难以应对新出现的伪造。为此,本文提出通用伪造定位方法(GIFL)。该方法通过学习图像原始内容中相对一致的通用特征,而非特定伪造痕迹,使模型在训练后能同时检测已见与未见的伪造图像,更具实际应用价值。此外,针对现有数据集仍以传统手工伪造为主的问题,本文构建了一个包含多种主流深度生成式编辑方法生成图像的新数据集,以推动对生成式伪造的检测研究。大量实验表明,所提方法在未见伪造检测上优于当前最优方法,且在已见伪造上也表现良好。代码与数据集已公开于 https://github.com/ZhaoHengrun/GIFL。

原文摘要 · Abstract (English)

In recent years, advanced image editing and generation methods have rapidly evolved, making detecting and locating forged image content increasingly challenging. Most existing image forgery detection methods rely on identifying the edited traces left in the image. However, because the traces of different forgeries are distinct, these methods can identify familiar forgeries included in the training data but struggle to handle unseen ones. In response, we present an approach for Generalizable Image Forgery Localization (GIFL). Once trained, our model can detect both seen and unseen forgeries, providing a more practical and efficient solution to counter false information in the era of generative AI. Our method focuses on learning general features from the pristine content rather than traces of specific forgeries, which are relatively consistent across different types of forgeries and therefore can be used as universal features to locate unseen forgeries. Additionally, as existing image forgery datasets are still dominated by traditional hand-crafted forgeries, we construct a new dataset consisting of images edited by various popular deep generative image editing methods to further encourage research in detecting images manipulated by deep generative models. Extensive experimental results show that the proposed approach outperforms state-of-the-art methods in the detection of unseen forgeries and also demonstrates competitive results for seen forgeries. The code and dataset are available at https://github.com/ZhaoHengrun/GIFL.

图像伪造通用特征生成式对抗检测定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。