arXiv:2506.16743cs.CV2025-06中稿 · TIFS 2025被引 8

通过分析图像噪声模式,提升对未知生成模型的伪造图检测能力。

Noise-Informed Diffusion-Generated Image Detection with Anomaly Attention

  • 利用扩散模型生成图共有的噪声特征,设计噪声感知注意力模块。
  • 在未见过的生成方法上达到当前最佳检测效果,准确率显著提升。
  • 适合关注生成图像安全、伪造检测的研究者与工程师使用。

随着扩散模型等图像生成技术的快速发展,合成图像质量大幅提升,引发信息安全隐患。为应对扩散模型的恶意滥用,图像伪造检测成为有效对策。然而,现有方法在面对训练时未见的生成模型时泛化能力不足。本文聚焦于图像噪声,发现不同扩散模型生成的图像具有相似的噪声模式,与真实图像明显不同。基于此,提出新颖的噪声感知自注意力(NASA)模块,专注于噪声区域以捕捉异常模式。将NASA嵌入Swin Transformer,构建新型检测架构NASA-Swin。同时采用跨模态融合嵌入,结合RGB图像与噪声图像,并引入通道掩码策略增强双模态特征学习。大量实验表明,该方法显著提升对扩散生成图像的检测能力,在未见生成方法上达到当前最优性能。代码已开源。

原文摘要 · Abstract (English)

With the rapid development of image generation technologies, especially the advancement of Diffusion Models, the quality of synthesized images has significantly improved, raising concerns among researchers about information security. To mitigate the malicious abuse of diffusion models, diffusion-generated image detection has proven to be an effective countermeasure.However, a key challenge for forgery detection is generalising to diffusion models not seen during training. In this paper, we address this problem by focusing on image noise. We observe that images from different diffusion models share similar noise patterns, distinct from genuine images. Building upon this insight, we introduce a novel Noise-Aware Self-Attention (NASA) module that focuses on noise regions to capture anomalous patterns. To implement a SOTA detection model, we incorporate NASA into Swin Transformer, forming an novel detection architecture NASA-Swin. Additionally, we employ a cross-modality fusion embedding to combine RGB and noise images, along with a channel mask strategy to enhance feature learning from both modalities. Extensive experiments demonstrate the effectiveness of our approach in enhancing detection capabilities for diffusion-generated images. When encountering unseen generation methods, our approach achieves the state-of-the-art performance.Our code is available at https://github.com/WeinanGuan/NASA-Swin.

图像检测扩散模型伪造识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。