通过放大伪造区域与真实图像流形的偏差,精准定位AI生成图片的篡改部分。
Detecting AI-Generated Forgeries via Iterative Manifold Deviation Amplification
- 用预训练的MAE模型作为真实图像先验,反向识别伪造痕迹。
- 在四个扩散修复基准上,平均提升6.5% IoU和8.1% F1-score。
- 适合需要高精度定位伪造区域的数字取证场景。
AI生成图像日益逼真,对数字取证提出挑战,亟需像素级精确定位篡改区域。现有方法多依赖特定伪造模式的判别特征,在新型编辑技术面前泛化能力不足。本文提出迭代伪造增强网络(IFA-Net),转变思路:不学“什么是假”,而建模“什么是真”。基于所有篡改均偏离自然图像流形的原理,IFA-Net采用在真实图像上预训练的冻结掩码自编码器(MAE)作为通用真实先验。框架采用两阶段闭环流程:首先由双流分割网络(DSSN)融合原图与MAE重建残差,实现粗略定位;随后任务自适应先验注入(TAPI)模块将粗预测转为引导提示,驱动MAE解码器在可疑区域放大重建失败,实现精炼。在四个基于扩散的修复基准上,IFA-Net相比第二佳方法平均提升6.5% IoU与8.1% F1-score,且对传统篡改类型也表现出强泛化能力。
原文摘要 · Abstract (English)
The proliferation of highly realistic AI-generated images poses critical challenges for digital forensics, demanding precise pixel-level localization of manipulated regions. Existing methods predominantly learn discriminative patterns of specific forgeries and often struggle with novel manipulations as editing techniques continue to evolve. We propose the Iterative Forgery Amplifier Network (IFA-Net), which shifts from learning "what is fake" to modeling "what is real". Grounded in the principle that all manipulations deviate from the natural image manifold, IFA-Net leverages a frozen Masked Autoencoder (MAE) pretrained on real images as a universal realness prior. Our framework operates through a two-stage closed-loop process: an initial Dual-Stream Segmentation Network (DSSN) fuses the original image with MAE reconstruction residuals for coarse localization, followed by a Task-Adaptive Prior Injection (TAPI) module that converts this coarse prediction into guiding prompts to steer the MAE decoder and amplify reconstruction failures in suspicious regions for precise refinement. Extensive experiments on four diffusion-based inpainting benchmarks show that IFA-Net achieves an average improvement of 6.5% in IoU and 8.1% in F1-score over the second-best method, while demonstrating strong generalization to traditional manipulation types.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。