arXiv:2607.28277cs.CV2026-07

融合多尺度卷积与Mamba,提升高光谱图像分类精度与效率

MSCM-net: A hyperspectral image classiffcation method based on multi-scale convolution and Mamba

论文配图:MSCM-net: A hyperspectral image classiffcation method based on multi-scale convolution and Mamba
图 1 · 摘自论文原文
  • 设计多尺度CNN与Mamba结合的架构,兼顾局部特征与长序列建模
  • 在三个基准数据集上实现领先性能,计算复杂度显著降低
  • 适合高光谱图像分类任务,尤其适用于资源受限场景

高光谱成像广泛应用于遥感和工程领域,其分类方法研究至关重要。尽管基于CNN和Transformer的方法已取得进展,但仍面临局部性限制和高计算复杂度问题。为此,本文提出一种新型高光谱图像分类模型MSCM-net。首先,设计了一种融合多尺度卷积与Mamba的网络架构,包含多尺度特征提取模块(MCSE)和多个堆叠的Mamba块,结合了多尺度CNN的局部特征提取能力与Mamba的长序列建模优势。其次,MCSE模块由不同尺度的卷积核和SENet组成,不同感受野的卷积核提取局部信息,增强空间-光谱特征融合;SENet使模型能自动学习多尺度特征中各通道的重要性。此外,提出双分支特征聚合模块,有效提取并融合中心像素的光谱信息与周围像素的空间信息。模型在三个常用基准数据集上进行了大量实验,结果表明MSCM-net在保持先进分类性能的同时,显著降低了计算复杂度。

原文摘要 · Abstract (English)

Hyperspectral imaging is widely used in remote sensing and engineering. Therefore, research on its classification methods is crucial. While CNN and Transformer-based methods have advanced, they still face locality constraints and high computational complexity. To address these issues, we propose an innovative hyperspectral image classification model, MSCM-net. Specifically, first of all, a model architecture combining multi-scale CNN and Mamba is proposed. It consists of a multi-scale feature extraction module (MCSE) and multiple stacked Mamba blocks, which integrates the local feature extraction capability of multi-scale CNN and the long sequence modeling advantage of Mamba. Secondly, the proposed MCSE module consists of multi-scale convolution and SENet. Convolution kernels of different scales extract local information with different receptive fields, enhancing the fusion of spatial and spectral information. Meanwhile, the SENet enables the model to automatically learn the importance of each channel in the multi-scale features. Furthermore, we also propose a dual-branch feature aggregation module, which further effectively extracts and integrates the spectral information contained in the central pixel and the spatial information in the surrounding pixels. Our model has undergone numerous experiments on three widely used benchmark datasets. The experimental results show that MSCM-net can achieve advanced classification performance while reducing computational complexity.

高光谱分类多尺度卷积Mamba特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。