arXiv:2507.02995cs.CVcs.CR2025-07ICCV被引 5

通过融合空间、频域与径向能量特征,精准识别Stable Diffusion 3.5生成图像。

FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Images

  • 三路并行结构:提取空间、频谱与径向能量特征
  • 在1万张图像上达97.8%准确率,领先现有方法5.2个百分点
  • 揭示0.1–0.4归一化频率范围的特有频谱信号,适合内容安全研究者

扩散模型的快速发展,尤其是Stable Diffusion 3.5,使得合成图像高度逼真,对现有检测方法构成严峻挑战。本文提出FreqCross,一种多模态融合网络,结合空间RGB特征、频域伪影及径向能量分布模式,实现对AI生成图像的鲁棒检测。该方法采用三分支架构:(1) 使用ResNet-18提取空间特征,(2) 用轻量CNN处理2D FFT幅值谱,(3) 用多层感知机分析径向能量分布。提出新型径向能量分析,捕捉扩散生成图像固有的频率伪影,并通过简单特征拼接与紧凑分类头融合空间与频域线索。在包含10,000张配对真实(MS-COCO)与合成(Stable Diffusion 3.5)图像的数据集上,实验表明FreqCross达到97.8%准确率,优于现有最优基线5.2个百分点。频域分析进一步揭示合成图像在0.1–0.4归一化频率范围具有显著谱特征,为方法提供理论支撑。代码与预训练模型已公开,支持可复现研究。

原文摘要 · Abstract (English)

The rapid advancement of diffusion models, particularly Stable Diffusion 3.5, has enabled the generation of highly photorealistic synthetic images that pose significant challenges to existing detection methods. This paper presents FreqCross, a novel multi-modal fusion network that combines spatial RGB features, frequency domain artifacts, and radial energy distribution patterns to achieve robust detection of AI-generated images. Our approach leverages a three-branch architecture: (1) a ResNet-18 backbone for spatial feature extraction, (2) a lightweight CNN for processing 2D FFT magnitude spectra, and (3) a multi-layer perceptron for analyzing radial energy profiles. We introduce a novel radial energy distribution analysis that captures characteristic frequency artifacts inherent in diffusion-generated images, and fuse it with spatial and spectral cues via simple feature concatenation followed by a compact classification head. Extensive experiments on a dataset of 10,000 paired real (MS-COCO) and synthetic (Stable Diffusion 3.5) images demonstrate that FreqCross achieves 97.8\% accuracy, outperforming state-of-the-art baselines by 5.2\%. The frequency analysis further reveals that synthetic images exhibit distinct spectral signatures in the 0.1--0.4 normalised frequency range, providing theoretical foundation for our approach. Code and pre-trained models are publicly available to facilitate reproducible research.

图像检测扩散模型频域分析多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。