arXiv:2608.28302cs.CV2026-08

FUSED能精准识别并定位AI修复图像,适应不同生成器。

FUSED: Forensic-Semantic Mixture-of-Experts for AI Inpainting Detection and Localization

论文配图:FUSED: Forensic-Semantic Mixture-of-Experts for AI Inpainting Detection and Localization
图 1 · 摘自论文原文
  • 用专家混合模型融合低层痕迹与高层语义特征
  • 在跨生成器数据集上检测与定位性能最优
  • 适合需要高精度图像伪造检测的研究者

基于扩散模型的图像修复仅修改局部区域,而许多AI图像检测器依赖全局伪影且无法定位。这些伪影随生成器变化,导致检测器在分布偏移下泛化能力差。近期研究发现,恢复修复区域外的真实像素可消除这些线索,从而削弱预训练检测器性能。为此,我们提出FUSED,一种统一框架,实现AI生成修复的联合检测与定位。FUSED采用稀疏门控的专家混合架构,融合低层取证线索与高层语义特征,使模型能自适应地为每个图像标记优先选择最相关信号。对每张输入图像,FUSED预测全局篡改得分与像素级修复掩码。在OpenSDID跨生成器基准上,FUSED实现最佳平均检测与定位性能,尤其在未见生成器上提升显著。同一模型直接迁移至保留的AutoSplice与CocoGlide基准,定位性能提升超过一倍。在有无全局生成器伪影条件下评估表明,所有方法(包括FUSED)部分依赖伪影作为篡改证据,但FUSED在两种情况下均保持最强表现。代码与预训练模型已开源。

原文摘要 · Abstract (English)

Diffusion-based inpainting models modify only a localized part of an image, while many AI-image detectors rely on global artifacts and do not localize. These artifacts vary across generators, limiting detector transfer under distribution shifts. Recent work shows that restoring the authentic pixels outside the inpainted region removes these cues and can degrade pretrained detectors. To address this, we present FUSED, a unified framework for the joint detection and localization of AI-generated inpainting. FUSED combines low-level forensic cues with high-level semantic features using a sparsely-gated Mixture-of-Experts architecture, enabling the model to adaptively prioritize the most relevant signal for each token. For each input, FUSED predicts both an image-level manipulation score and a pixel-level mask of the inpainted area. On the OpenSDID cross-generator benchmark, FUSED achieves the best average detection and localization, with the largest gains on unseen generators. The same model transfers directly to the held-out AutoSplice and CocoGlide benchmarks, more than doubling localization performance. Evaluating each held-out benchmark with and without the global generator artifact further shows that all evaluated methods, ours included, partly read the artifact as evidence of manipulation, and FUSED remains the strongest under both conditions. Code and pretrained models are available at https://github.com/AntonNuzhdin/FUSED.

图像伪造检测扩散模型专家混合定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。