arXiv:2511.23377cs.CV2025-11被引 1

构建30万规模数据集,定位扩散模型生成的自然篡改区域。

DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline

  • 用多模态大模型生成指令,无遮罩扩散编辑器生成图像,主动学习标注像素级篡改区域。
  • 在自建测试集上达82.56%像素级F1,在外部基准CoCoGlide上达80.97%。
  • 首次针对扩散编辑特点设计频率提示调优框架,适合伪造检测与内容安全研究者。

基于扩散模型的图像编辑使普通用户能轻松进行语义级操作,但也催生了难以定位的真实局部伪造。现有基准多关注生成图像的二分类或手动编辑区域定位,未能反映扩散编辑通常与原内容自然融合的特点。本文提出扩散模型篡改定位数据集DEAL-300K,包含超过30万张标注图像,用于扩散模型图像篡改定位(DIML)研究。通过多模态大语言模型生成编辑指令,使用无遮罩扩散编辑器生成篡改图像,并采用主动学习变化检测流程获取像素级标注。在此基础上,提出一种定位框架:结合冻结视觉基础模型与多频段提示调优(MFPT),捕捉篡改区域的语义与频域特征。在DEAL-300K自建测试集上,方法达到82.56%像素级F1;在外部基准CoCoGlide上达80.97%,为未来DIML研究提供强基线与实用基础。数据集可通过https://github.com/ymhzyj/DEAL-300K获取。

原文摘要 · Abstract (English)

Diffusion-based image editing has made semantic level image manipulation easy for general users, but it also enables realistic local forgeries that are hard to localize. Existing benchmarks mainly focus on the binary detection of generated images or the localization of manually edited regions and do not reflect the properties of diffusion-based edits, which often blend smoothly into the original content. We present Diffusion-Based Image Editing Area Localization Dataset (DEAL-300K), a large scale dataset for diffusion-based image manipulation localization (DIML) with more than 300,000 annotated images. We build DEAL-300K by using a multi-modal large language model to generate editing instructions, a mask-free diffusion editor to produce manipulated images, and an active-learning change detection pipeline to obtain pixel-level annotations. On top of this dataset, we propose a localization framework that uses a frozen Visual Foundation Model (VFM) together with Multi Frequency Prompt Tuning (MFPT) to capture both semantic and frequency-domain cues of edited regions. Trained on DEAL-300K, our method reaches a pixel-level F1 score of 82.56% on our test split and 80.97% on the external CoCoGlide benchmark, providing strong baselines and a practical foundation for future DIML research.The dataset can be accessed via https://github.com/ymhzyj/DEAL-300K.

图像伪造扩散模型定位检测数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。