提出端到端去噪扩散模型,精准识别扩散模型修复图像
End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection
- 设计端到端去噪重建模型,对齐生成与检测潜空间
- 引入多尺度融合模块,提升局部特征区分能力
- 在五类掩码图像上验证,对未知遮挡模式仍有效
扩散模型强大的生成能力推动了图像合成与基于修复的编辑技术发展,但也带来滥用风险。现有方法难以识别由扩散修复模型生成的图像,即使训练数据中包含类似修复样本。为此,本文提出基于端到端去噪扩散(End4)的新检测方法:通过去噪重建模型增强重建与检测潜空间的一致性,从而恢复更利于检测的特征;同时采用尺度感知金字塔融合模块(SPFM),在不同尺度注意力层引导下优化局部特征,提升判别力。为评估性能,构建涵盖五种不同掩码区域的综合性基准。大量实验表明,该方法能有效泛化至未见遮挡模式,并在多种扰动下保持鲁棒性。代码与数据集即将开源。
原文摘要 · Abstract (English)
The powerful generative capabilities of diffusion models have significantly advanced the field of image synthesis, enhancing both full image generation and inpainting-based image editing. Despite their remarkable advancements, diffusion models also raise concerns about potential misuse for malicious purposes. However, existing approaches struggle to identify images generated by diffusion-based inpainting models, even when similar inpainted images are included in their training data. To address this challenge, we propose a novel detection method based on End-to-end denoising diffusion (End4). Specifically, End4 designs a denoising reconstruction model to improve the alignment degree between the latent spaces of the reconstruction and detection processes, thus reconstructing features that are more conducive to detection. Meanwhile, it leverages a Scale-aware Pyramid-like Fusion Module (SPFM) that refines local image features under the guidance of attention pyramid layers at different scales, enhancing feature discriminability. Additionally, to evaluate detection performance on inpainted images, we establish a comprehensive benchmark comprising images generated from five distinct masked regions. Extensive experiments demonstrate that our End4 effectively generalizes to unseen masking patterns and remains robust under various perturbations. Our code and dataset will be released soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。