arXiv:2605.16879cs.CV2026-05

用生成模型定位图像篡改,能识别没见过的修改类型。

Towards Generalized Image Manipulation Localization via Score-based Model

论文配图:Towards Generalized Image Manipulation Localization via Score-based Model
图 1 · 摘自论文原文
  • 通过得分函数建模掩码分布几何结构,避免传统方法过拟合。
  • 在8个非生成和3个生成数据集上均超越现有方法,泛化性能显著。
  • 适合需要高泛化能力的图像真实性检测场景,如社交媒体审核。

随着合成媒体快速发展,图像篡改定位(IML)已成为保障数字内容完整性的关键环节。然而,泛化仍是核心挑战:现有判别方法通常学习固定决策边界,易过拟合特定训练痕迹,难以适应未见篡改类型。为此,本文提出DiffIML,引入基于得分的生成建模解决IML问题。不同于直接估计硬边界,DiffIML逼近对数似然梯度(即得分函数),捕捉掩码分布的内在几何拓扑结构。该范式利用结构先验,从噪声中迭代恢复连贯掩码,克服判别模型的脆弱性。在此框架下,扩散模型作为得分函数的有效数值求解器。为提升实用性,分别通过轻量级掩码专用VAE加速潜空间处理、解耦架构搭配轻量去噪UNet提升效率,并采用边缘监督与误差先验缓解采样过程中的误差累积。在八个非生成型与三个生成型基准上,两种不同评估协议的大量实验表明,DiffIML持续优于最先进方法,在多样未见数据集上实现显著泛化提升。代码已公开于https://github.com/scu-zjz/DiffIML。

原文摘要 · Abstract (English)

With the rapid evolution of synthetic media, Image Manipulation Localization (IML) has emerged as a critical component in multimedia forensics for ensuring the integrity of digital content. However, generalization remains a core challenge, as existing discriminative methods typically learn a fixed decision boundary that tends to overfit to specific training artifacts and fails to adapt to unseen manipulation types. To address this, we propose DiffIML, a novel framework that introduces score-based generative modeling to IML. Diverging from the direct estimation of hard boundaries, DiffIML approximates the score function, the gradient of the log-likelihood, to capture the intrinsic geometric topology of mask distributions. This paradigm leverages structural priors to iteratively recover coherent masks from noise, thereby circumventing the brittleness associated with discriminative models. Under this formulation, diffusion models serve as an effective numerical solver for the learned score function.To ensure practicality, we respectively resolve the efficiency and stability bottlenecks of standard diffusion by: (1) utilizing a Lightweight Mask-Specific VAE for fast latent-space process and a decoupled architecture with a lightweight denoising UNet, (2) edge supervision and error prior to mitigate error accumulation during sampling. Extensive experiments of two distinct protocols on eight non-generative and three generative benchmarks demonstrate that DiffIML consistently outperforms state-of-the-art methods, yielding remarkable generalization improvements on diverse unseen datasets. The code is publicly available at https://github.com/scu-zjz/DiffIML.

图像伪造检测生成模型泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。