提出EDGER框架,精准定位跨域图像伪造区域。
EDGER: EDge-Guided with HEatmap Refinement for Generalizable Image Forgery Localization

- 双分支设计:边缘引导分割+合成热图定位
- 在多兆像素图像上实现跨域高精度定位
- 适合需要泛化能力的图像真实性检测场景
文本引导修复使图像伪造愈发逼真,给图像伪造定位(IFL)带来挑战。现有方法难以在不同数据域间有效识别可疑区域。为此,我们提出EDGER,一种基于补丁的双分支框架,可在任意分辨率图像中定位篡改区域,且不损失原始分辨率。第一分支“边缘引导分割”引入频域边缘检测器,强调篡改边界处的高频不一致,并微调SegFormer融合RGB与边缘特征生成像素级掩码。由于边缘证据仅在包含真实与伪造像素的补丁中最具信息量,我们增设“合成热图”分支——基于分类的局部定位器,通过LoRA微调CLIP-ViT图像编码器,标记全合成补丁。两者协同:合成热图提供粗粒度补丁级伪造先验,边缘引导分割细化部分篡改补丁的边界,实现全面定位。在MediaEval 2025 SynthIM挑战赛的篡改区域定位任务中,该方法可扩展至多兆像素图像,展现出强跨域泛化能力。大量消融实验表明,频域边缘线索与补丁级合成先验具有互补性,共同驱动准确、分辨率无关的定位。
原文摘要 · Abstract (English)
Text-guided inpainting has made image forgery increasingly realistic, challenging both SID and IFL. However, existing methods often struggle to point out suspicious signals across domains. To address this problem, we propose EDGER, a patch-based, dual-branch framework that localizes manipulated regions in arbitrary resolution images without sacrificing native resolution. The first branch, Edge-Guided Segmentation, introduces a Frequency-based Edge Detector to emphasize high-frequency inconsistencies at manipulation boundaries, and fine-tunes a SegFormer to fuse RGB and edge features for pixel-level masks. Since edge evidence is most informative only when patches contain both authentic and manipulated pixels, we complement Edge-Guided Segmentation with a Synthetic Heatmapping branch, a classification-based localizer that fine-tunes a CLIP-ViT image encoder with LoRA to flag fully synthetic patches. Together, Synthetic Heatmapping provides coarse, patch-level synthetic priors, while Edge-Guided Segmentation sharpens boundaries within partially manipulated patches, yielding comprehensive localization. Evaluated in the MediaEval 2025, SynthIM challenge, Manipulated Region Localization Task's setting, our approach scales to multi-megapixel imagery and exhibits strong cross-domain generalization. Extensive ablations highlight the complementary roles of frequency-based edge cues and patch-level synthetic priors in driving accurate, resolution-agnostic localization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。