arXiv:2508.06101cs.CV2025-08

用生成式扩散模型统一解决有约束与无约束图像篡改定位问题

UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization

  • 基于扩散模型学习数据分布,减少对标注数据的依赖
  • 在多个数据集上分别实现9.66和4.36的F1提升
  • 端到端设计支持两种任务无缝切换,适合实际部署

在数字时代,高级图像编辑工具严重威胁视觉内容完整性,图像篡改检测与定位成为研究重点。现有图像篡改定位(IML)方法多依赖判别式学习,需大量高质量标注数据,但当前数据集规模与多样性不足,限制了真实场景下的性能。为此,近期研究提出有约束图像篡改定位(CIML),通过算法监督生成像素级标注,但现有方法常依赖复杂多阶段流程,标注效率低。本文提出首个统一生成式扩散框架UGD-IML,首次将IML与CIML任务整合于单一框架。通过学习数据分布,生成式扩散模型降低对大规模标注数据的依赖,使模型在小样本条件下仍表现优异。结合类别嵌入与参数共享设计,模型可无缝切换两种模式,无需额外组件或训练开销。端到端架构避免繁琐标注步骤。在多个数据集上的实验表明,UGD-IML在IML和CIML任务中平均F1指标分别优于当前最优方法9.66和4.36。此外,该方法在不确定性估计、可视化和鲁棒性方面也表现突出。

原文摘要 · Abstract (English)

In the digital age, advanced image editing tools pose a serious threat to the integrity of visual content, making image forgery detection and localization a key research focus. Most existing Image Manipulation Localization (IML) methods rely on discriminative learning and require large, high-quality annotated datasets. However, current datasets lack sufficient scale and diversity, limiting model performance in real-world scenarios. To overcome this, recent studies have explored Constrained IML (CIML), which generates pixel-level annotations through algorithmic supervision. However, existing CIML approaches often depend on complex multi-stage pipelines, making the annotation process inefficient. In this work, we propose a novel generative framework based on diffusion models, named UGD-IML, which for the first time unifies both IML and CIML tasks within a single framework. By learning the underlying data distribution, generative diffusion models inherently reduce the reliance on large-scale labeled datasets, allowing our approach to perform effectively even under limited data conditions. In addition, by leveraging a class embedding mechanism and a parameter-sharing design, our model seamlessly switches between IML and CIML modes without extra components or training overhead. Furthermore, the end-to-end design enables our model to avoid cumbersome steps in the data annotation process. Extensive experimental results on multiple datasets demonstrate that UGD-IML outperforms the SOTA methods by an average of 9.66 and 4.36 in terms of F1 metrics for IML and CIML tasks, respectively. Moreover, the proposed method also excels in uncertainty estimation, visualization and robustness.

图像篡改扩散模型生成式方法定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。