arXiv:2608.12155cs.CV2026-08

发现基础模型靠低中频分布差异识别生成图像,而非语义错误或高频伪影。

Understanding Why Foundation Models Work for Diffusion-Generated Image Detection

论文配图:Understanding Why Foundation Models Work for Diffusion-Generated Image Detection
图 1 · 摘自论文原文
  • 用DDIM反演生成语义相同但合成痕迹不同的图像,测试检测器响应变化。
  • 检测器主要依赖低至中频段的细微分布差异,而非高频频段的常见伪影。
  • 适合关注生成图像检测机制、可解释性取证的研究者阅读。

视觉基础模型最近成为检测AI生成图像的强大特征提取器,在不同生成器间具有强泛化能力,并对常见图像退化保持鲁棒性。然而,其有效性的原因仍不清晰。本文通过设计基于DDIM反演的分析协议,探究基础模型检测器区分真实图像与扩散生成图像所依赖的线索。给定一张真实图像,我们通过改变DDIM反演深度生成一系列语义相同的合成副本。尽管多数副本与原图在语义上完全一致,检测器得分却显著变化,表明其决策并非主要由语义失败驱动。频率交换分析进一步揭示,检测器利用的判别线索主要集中于低至中频范围,而非生成模型常见的高频伪影。最后,潜空间分析显示,重生成图像的方差和有效维度降低,说明扩散模型未能完全复现真实数据的多样性。总体而言,结果表明基础模型检测器的成功源于捕捉真实与生成图像在非语义低至中频分布上的差异。这些发现为检测器的鲁棒性与泛化能力提供了新见解,并指明了更具可解释性的取证方法方向。

原文摘要 · Abstract (English)

Vision foundation models have recently emerged as powerful feature extractors for detecting AI-generated images, achieving strong generalization across generators and robustness to common image degradations. However, the reason behind their effectiveness is poorly understood. In this work, we investigate what cues are exploited by foundation-model-based detectors to distinguish real images from diffusion-generated ones. To this end, we design an ad hoc analysis protocol based on DDIM inversion. Given a real image we generate a sequence of synthetic copies by changing the depth of DDIM inversion. Even though most copies are semantically identical to the real reference, the detector score varies significantly across them due to subtle traces introduced by the diffusion synthesis, showing that its decision is not primarily driven by semantic failures. Through a frequency-swapping analysis, we further reveal that the discriminative cues exploited by the detectors are mainly localized in the low-to-mid frequency range, rather than only in the high-frequency range, as is the case for artifacts commonly associated with generative models. Finally, a latent-space analysis shows that regenerated images exhibit reduced variance and effective dimensionality, indicating that diffusion models do not fully reproduce the variability of real data. Overall, our results suggest that foundation-model-based detectors succeed by capturing non-semantic low-to-mid frequency distributional discrepancies between real and diffusion-generated images. These findings provide new insight into the robustness and generalization of such detectors and suggest directions for more interpretable forensic methods.

图像检测扩散模型可解释性伪造识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。