通过扩散模型重建测试图像,捕捉其‘回弹’特性以识别AI生成图像。
Detecting AI-Generated Images via Diffusion Snap-Back Reconstruction: A Forensic Approach
- 利用扩散模型对图像微扰后重建,观察其响应行为作为检测信号。
- 在4000张图像上达到0.993的AUROC,几乎可完美区分真伪图像。
- 适合需要高可信度检测的媒体真实性验证场景,如新闻、司法。
生成图像模型的快速发展已使AI生成图像难以被人类或传统检测方法识别。现代文本到图像系统如Stable Diffusion和DALL E能生成几乎完全自然的图像,极少留下可见痕迹。为此,本文提出一种新思路:通过轻微扰动图像并用扩散模型重建,观察其“扩散回弹”行为。通过跟踪LPIPS、SSIM和PSNR等感知相似度指标随重建强度的变化,提取紧凑且可解释的信号,反映图像与扩散模型去噪规律的契合程度。在包含4000张真实与AI生成图像的平衡数据集上,该方法在分层五折交叉验证下实现0.993的AUROC,持留测试集上达0.990,仅使用逻辑回归即可达成。初步鲁棒性测试显示,该方法对压缩、噪声等常见现实干扰保持稳定。尽管实验基于单一扩散主干,结果表明重建行为可成为未来更逼真生成模型下可靠且可扩展的伪造检测基础。
原文摘要 · Abstract (English)
The rapid advancement of generative image models has transformed digital media to the point where AI generated images can no longer be reliably distinguished from authentic photographs by human observers or many conventional detection methods. Modern text to image systems such as Stable Diffusion and DALL E can now generate images so realistic that they often appear completely natural, leaving little to no visible artifacts for traditional deepfake detectors to rely on. This challenge has practical consequences for misinformation control, institutional identity verification, and digital trust in political and legal contexts. Instead of searching for hidden pixel level traces, we take a different approach: we observe how an image responds when it is gently disturbed and reconstructed by a diffusion model. We call this behavior diffusion snap back. By tracking how perceptual similarity measures (LPIPS, SSIM, and PSNR) change across different reconstruction strengths, we capture compact and interpretable signals that reveal how closely an image aligns with the diffusion model's learned denoising behavior. Evaluated on a balanced dataset of 4,000 human and AI generated images, the proposed method achieves an AUROC of 0.993 under stratified five fold cross validation and 0.990 on a holdout split using only logistic regression. Initial robustness tests show that the method remains stable under common real world distortions such as image compression and added noise. Although our experiments were conducted using a single diffusion backbone, the results indicate that reconstruction behavior can serve as a reliable and scalable foundation for synthetic media detection as generative models continue to grow more realistic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。