arXiv:2607.17441cs.CVcs.LG2026-07

用FFT融合空间与频域特征,提升伪造图像检测精度。

An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detection

论文配图:An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detection
图 1 · 摘自论文原文
  • 结合Xception空间分支与FFT频域分支,通过交叉注意力融合
  • 在多个数据集上优于现有DCT方法,准确率提升显著
  • 可解释性分析聚焦眼、口、鼻等篡改敏感区域,适合安全监管

深度伪造生成引发数字媒体真实性、虚假信息、身份欺诈和公众信任的广泛关注。研究表明,联合使用空间与频域特征比单独使用效果更优。本文提出MSCA-FFT,一种基于快速傅里叶变换(FFT)的多尺度交叉注意力框架,用于图像级深度伪造检测。模型包含部分微调的Xception空间分支与基于FFT的频域分支,后者对对数缩放的FFT幅值谱进行浅层卷积处理,避免了传统DCT流程中的逆频率到图像重构。空间与频域表征经Transformer编码器优化,通过交叉注意力融合,最终送入MLP分类器进行真实/伪造判断。实验表明,MSCA-FFT在多个数据集上持续优于基于DCT的最先进融合方法及对比基线模型。消融实验证明,频域分支在与空间特征融合时提供了互补的频谱线索。此外,基于FFT的频域分析与Grad-CAM/LIME解释结果在篡改敏感面部区域(如眼、口、鼻及面部边界)上表现出一致证据。

原文摘要 · Abstract (English)

Deepfake generation has raised growing concerns regarding digital media authenticity, misinformation, identity fraud, and public trust. Recent studies show that combining spatial and frequency features leads to stronger detection results than using independently. This paper presents MSCA-FFT, a Fast Fourier Transform (FFT)-based multi-scale cross-attention framework for image-level deepfake detection. The model combines a partially fine-tuned Xception spatial branch with an FFT-based frequency branch. The frequency branch processes the log-scaled FFT magnitude spectrum through shallow convolutional layers, avoiding inverse frequency-to-image reconstruction used in DCT-based pipelines. The spatial and frequency representations are refined by transformer encoders, fused through cross-attention, and passed to an MLP classifier for real/fake prediction. Experimental results show that MSCA-FFT achieves consistently higher performance than the DCT-based state-of-the-art spatial-frequency fusion method and the compared baseline models. The ablation study further indicates that the FFT-based frequency branch provides complementary spectral cues when fused with spatial features. In addition, FFT-based frequency analysis and Grad-CAM/LIME explanations show consistent evidence around manipulation-sensitive facial regions, including the eyes, mouth, nose, and facial boundaries.

深度伪造检测频域分析可解释性FFT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。