用频域门控取代复杂状态空间模型,高效提升遥感图像分类精度。
MambaOutRS: A Hybrid CNN-Fourier Architecture for Remote Sensing Image Classification
- 结合门控卷积与频域门控模块,分层提取局部与全局特征。
- 参数量仅2400万即达UC Merced 98.41%、AID 95.99% F1分数,超越大模型。
- 适合追求高精度与低计算成本的遥感图像分析场景。
深度学习在视觉任务中的进展催生了如Mamba等状态空间模型(SSMs),其线性可扩展性备受关注。然而,将这类模型适配二维视觉数据常需复杂改造,可能影响效率。本文提出MambaOutRS,一种用于遥感图像分类的新颖混合卷积-傅里叶架构。该模型基于堆叠的门控卷积块提取局部特征,并引入创新的傅里叶滤波门(FFG)模块,在频域高效捕获全局上下文信息。采用四阶段分层设计,在UC Merced、AID、NWPU-RESISC45和EuroSAT等挑战性遥感数据集上广泛评估。结果表明,MambaOutRS在所有基准上持续达到最优性能。其中,参数量为24.0M的MambaOutRS-t变体,在UC Merced上取得98.41%的最高F1分数,在AID上达95.99%,显著优于现有基线,包括更大规模的Transformer与基于Mamba的架构,且参数更少。消融实验证明傅里叶滤波门对捕捉全局空间模式至关重要,显著提升分类鲁棒性与准确性。结果表明,递归状态空间模型的复杂性可被精心组合的门控卷积与频域门控有效替代。因此,MambaOutRS为遥感及其他视觉领域提供了高效高性能的深度学习建模范式,尤其适用于计算资源受限场景。
原文摘要 · Abstract (English)
Recent advances in deep learning for vision tasks have seen the rise of State Space Models (SSMs) like Mamba, celebrated for their linear scalability. However, their adaptation to 2D visual data often necessitates complex modifications that may diminish efficiency. In this paper, we introduce MambaOutRS, a novel hybrid convolutional architecture for remote sensing image classification that re-evaluates the necessity of recurrent SSMs. MambaOutRS builds upon stacked Gated CNN blocks for local feature extraction and introduces a novel Fourier Filter Gate (FFG) module that operates in the frequency domain to capture global contextual information efficiently. Our architecture employs a four-stage hierarchical design and was extensively evaluated on challenging remote sensing datasets: UC Merced, AID, NWPU-RESISC45, and EuroSAT. MambaOutRS consistently achieved state-of-the-art (SOTA) performance across these benchmarks. Notably, our MambaOutRS-t variant (24.0M parameters) attained the highest F1-scores of 98.41\% on UC Merced and 95.99\% on AID, significantly outperforming existing baselines, including larger transformer models and Mamba-based architectures, despite using considerably fewer parameters. An ablation study conclusively demonstrates the critical role of the Fourier Filter Gate in enhancing the model's ability to capture global spatial patterns, leading to robust and accurate classification. These results strongly suggest that the complexities of recurrent SSMs can be effectively superseded by a judicious combination of gated convolutions for spatial mixing and frequency-based gates for spectral global context. Thus, MambaOutRS provides a compelling and efficient paradigm for developing high-performance deep learning models in remote sensing and other vision domains, particularly where computational efficiency is paramount.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。