arXiv:2505.11753cs.CV2025-05CVPR被引 5

提出新方法X-Edit,精准定位文本生成图像的篡改区域。

X-Edit: Detecting and Localizing Edits in Images Altered by Text-Guided Diffusion Models

  • 用反演特征+注意力机制定位编辑区域
  • 在PSNR和SSIM上优于基线模型
  • 适合图像取证与深度伪造检测研究者

文本引导的扩散模型显著提升了图像编辑的逼真度和局部性,但其被恶意使用也带来了深度伪造检测难题。为此,我们提出X-Edit,一种针对扩散模型修改图像的局部化检测方法。通过预训练扩散模型对图像进行反演,将获得的特征输入分割网络,利用通道与空间注意力显式预测编辑区域。进一步结合分割损失与相关性损失进行微调:分割损失平衡像素级误差与感知相似性;相关性损失引导模型关注低频区域,抑制高频伪影,提升对细微篡改的定位能力。据我们所知,这是首个系统建模扩散图像编辑区域定位问题的工作。同时,我们构建了一个包含原始与编辑图像对的新数据集,填补该领域资源空白。实验表明,X-Edit在文本引导扩散模型生成的篡改图像上实现了高精度定位,各项指标优于现有基线,展现出作为图像伪造检测工具的强潜力。

原文摘要 · Abstract (English)

Text-guided diffusion models have significantly advanced image editing, enabling highly realistic and local modifications based on textual prompts. While these developments expand creative possibilities, their malicious use poses substantial challenges for detection of such subtle deepfake edits. To this end, we introduce Explain Edit (X-Edit), a novel method for localizing diffusion-based edits in images. To localize the edits for an image, we invert the image using a pretrained diffusion model, then use these inverted features as input to a segmentation network that explicitly predicts the edited masked regions via channel and spatial attention. Further, we finetune the model using a combined segmentation and relevance loss. The segmentation loss ensures accurate mask prediction by balancing pixel-wise errors and perceptual similarity, while the relevance loss guides the model to focus on low-frequency regions and mitigate high-frequency artifacts, enhancing the localization of subtle edits. To the best of our knowledge, we are the first to address and model the problem of localizing diffusion-based modified regions in images. We additionally contribute a new dataset of paired original and edited images addressing the current lack of resources for this task. Experimental results demonstrate that X-Edit accurately localizes edits in images altered by text-guided diffusion models, outperforming baselines in PSNR and SSIM metrics. This highlights X-Edit's potential as a robust forensic tool for detecting and pinpointing manipulations introduced by advanced image editing techniques.

图像伪造扩散模型定位检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。