arXiv:2510.04628cs.CV2025-10被引 1

提出跨空间谱频域交互网络,提升多模态遥感分类精度

A Spatial-Spectral-Frequency Interactive Network for Multimodal Remote Sensing Classification

论文配图:A Spatial-Spectral-Frequency Interactive Network for Multimodal Remote Sensing Classification
图 1 · 摘自论文原文
  • 设计空间-谱-频三域交互机制,融合多维特征
  • 在四个数据集上超越现有方法,小样本下表现更优
  • 适合遥感图像分析、多源数据融合研究者使用

基于深度学习的方法在遥感地球观测数据分析中取得显著进展。尽管众多特征融合技术通过整合全局与局部特征提升了多模态遥感图像分类性能,但仍难以从异构且冗余的多模态图像中有效提取结构和细节特征。为引入频域学习以建模关键稀疏细节特征,本文提出空间-谱-频交互网络(S²Fin),该网络在空间、谱和频域间集成配对融合模块。具体地,提出高频稀疏增强变压器,利用稀疏空间-谱注意力优化高频滤波器参数;随后设计两级空间-频域融合策略,包括自适应频域通道模块,用于融合低频结构与增强的高频细节,以及高频共振掩码,通过相位相似性突出锐利边缘。此外,空间-谱注意力融合模块进一步增强了网络中间层的特征提取能力。在四个基准多模态数据集上,采用有限标注数据的实验表明,S²Fin在分类性能上优于当前最优方法。代码已开源:https://github.com/HaoLiu-XDU/SSFin。

原文摘要 · Abstract (English)

Deep learning-based methods have achieved significant success in remote sensing Earth observation data analysis. Numerous feature fusion techniques address multimodal remote sensing image classification by integrating global and local features. However, these techniques often struggle to extract structural and detail features from heterogeneous and redundant multimodal images. With the goal of introducing frequency domain learning to model key and sparse detail features, this paper introduces the spatial-spectral-frequency interaction network (S$^2$Fin), which integrates pairwise fusion modules across the spatial, spectral, and frequency domains. Specifically, we propose a high-frequency sparse enhancement transformer that employs sparse spatial-spectral attention to optimize the parameters of the high-frequency filter. Subsequently, a two-level spatial-frequency fusion strategy is introduced, comprising an adaptive frequency channel module that fuses low-frequency structures with enhanced high-frequency details, and a high-frequency resonance mask that emphasizes sharp edges via phase similarity. In addition, a spatial-spectral attention fusion module further enhances feature extraction at intermediate layers of the network. Experiments on four benchmark multimodal datasets with limited labeled data demonstrate that S$^2$Fin performs superior classification, outperforming state-of-the-art methods. The code is available at https://github.com/HaoLiu-XDU/SSFin.

遥感分类多模态融合频域学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。