提出分组间隔的Mamba架构,高效提取高光谱图像空间光谱信息。
IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification
- 分组间隔S6机制按间隔划分特征,多方向扫描减少冗余。
- 在多个数据集上达到新纪录,精度提升1.5%-3.2%。
- 适合处理高维高冗余高光谱数据,轻量高效可部署。
高光谱图像(HSI)分类在遥感领域受到广泛关注。基于选择性状态空间模型(S6)的Mamba架构在长序列建模中展现出巨大潜力,但高维数据和信息冗余导致其在HSI分类中性能不佳且计算效率低。为此,本文提出一种轻量级的区间分组空间-光谱Mamba框架(IGroupSS-Mamba),通过分组层级方式实现多方向、多尺度的空间-光谱全局信息提取。核心技术为区间分组S6机制(IGSM),将高维特征按间隔非重叠分组,每组采用特定扫描方向的单向S6进行建模,既利用不同方向优势又降低计算开销。为充分捕捉空间-光谱上下文信息,引入区间分组空间-光谱块(IGSSB),串联两个基于IGSM的空间与光谱算子,分别建模空间与光谱维度的全局关系。整个网络以多层IGSSB堆叠构成层次结构,并结合基于像素聚合的下采样策略,实现从浅层到深层的多尺度语义学习。大量实验表明,IGroupSS-Mamba优于现有最优方法,在Indian Pines、Pavia University等数据集上准确率提升1.5%-3.2%。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) classification has garnered substantial attention in remote sensing fields. Recent Mamba architectures built upon the Selective State Space Models (S6) have demonstrated enormous potential in long-range sequence modeling. However, the high dimensionality of hyperspectral data and information redundancy pose challenges to the application of Mamba in HSI classification, suffering from suboptimal performance and computational efficiency. In light of this, this paper investigates a lightweight Interval Group Spatial-Spectral Mamba framework (IGroupSS-Mamba) for HSI classification, which allows for multi-directional and multi-scale global spatial-spectral information extraction in a grouping and hierarchical manner. Technically, an Interval Group S6 Mechanism (IGSM) is developed as the core component, which partitions high-dimensional features into multiple non-overlapping groups at intervals, and then integrates a unidirectional S6 for each group with a specific scanning direction to achieve non-redundant sequence modeling. Compared to conventional applying multi-directional scanning to all bands, this grouping strategy leverages the complementary strengths of different scanning directions while decreasing computational costs. To adequately capture the spatial-spectral contextual information, an Interval Group Spatial-Spectral Block (IGSSB) is introduced, in which two IGSM-based spatial and spectral operators are cascaded to characterize the global spatial-spectral relationship along the spatial and spectral dimensions, respectively. IGroupSS-Mamba is constructed as a hierarchical structure stacked by multiple IGSSB blocks, integrating a pixel aggregation-based downsampling strategy for multiscale spatial-spectral semantic learning from shallow to deep stages. Extensive experiments demonstrate that IGroupSS-Mamba outperforms the state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。