融合空间与频域特征,提升遥感图像伪造检测精度与泛化能力
SFNet: Fusion of Spatial and Frequency-Domain Features for Remote Sensing Image Forgery Detection
- 双分支结构分别提取空间与频域特征,捕捉不同伪造痕迹
- 通过注意力机制融合多域特征,在三个数据集上提升4%-15.18%准确率
- 适用于复杂地理环境下生成式伪造遥感图像的检测,适合遥感安全研究者
生成式人工智能快速发展催生了日益逼真的虚假遥感影像(RSI),难以检测,可能引发错误情报、虚假新闻甚至阴谋论。现有方法多依赖单一视觉特征,如空间域线索检测道路或建筑等伪造对象,或频域特征识别对抗生成网络(GAN)中上采样操作产生的伪影。然而,伪影特性随地理地形、地表覆盖类型及具体特征差异显著变化,且随着生成模型迭代不断演化。因此,过度依赖单一视觉线索导致现有检测器在多样化遥感数据上泛化能力差。本文提出SFNet框架,通过融合空间与频域特征实现对多样化遥感数据中伪造图像的精准识别。具体而言,SFNet采用两个独立特征提取器,分别从输入的遥感影像中提取空间和频域特征;为充分挖掘互补信息,设计域特征映射模块与混合域特征精炼模块(结合CBAM注意力机制),逐级对齐并融合多域特征,同时抑制冗余信息。在三个数据集上的实验表明,SFNet相较当前最优方法准确率提升4%至15.18%,展现出优异的泛化能力。代码已公开于https://github.com/GeoX-Lab/RSTI/tree/main/SFNet。
原文摘要 · Abstract (English)
The rapid advancement of generative artificial intelligence is producing fake remote sensing imagery (RSI) that is increasingly difficult to detect, potentially leading to erroneous intelligence, fake news, and even conspiracy theories. Existing forgery detection methods typically rely on single visual features to capture predefined artifacts, such as spatial-domain cues to detect forged objects like roads or buildings in RSI, or frequency-domain features to identify artifacts from up-sampling operations in adversarial generative networks (GANs). However, the nature of artifacts can significantly differ depending on geographic terrain, land cover types, or specific features within the RSI. Moreover, these complex artifacts evolve as generative models become more sophisticated. In short, over-reliance on a single visual cue makes existing forgery detectors struggle to generalize across diverse remote sensing data. This paper proposed a novel forgery detection framework called SFNet, designed to identify fake images in diverse remote sensing data by leveraging spatial and frequency domain features. Specifically, to obtain rich and comprehensive visual information, SFNet employs two independent feature extractors to capture spatial and frequency domain features from input RSIs. To fully utilize the complementary domain features, the domain feature mapping module and the hybrid domain feature refinement module(CBAM attention) of SFNet are designed to successively align and fuse the multi-domain features while suppressing redundant information. Experiments on three datasets show that SFNet achieves an accuracy improvement of 4%-15.18% over the state-of-the-art RS forgery detection methods and exhibits robust generalization capabilities. The code is available at https://github.com/GeoX-Lab/RSTI/tree/main/SFNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。