arXiv:2504.15612cs.CV2025-04被引 1

提出HS-Mamba框架,提升高光谱图像分类精度

HS-Mamba: Full-Field Interaction Multi-Groups Mamba for Hyperspectral Image Classification

  • 分块与整图并行处理,融合局部与全局特征
  • 在4个基准数据集上超越现有最优方法
  • 适合需要高精度分类的遥感图像分析场景

高光谱图像(HSI)分类是遥感领域的热点。近年来,基于选择性状态空间模型(S6)的Mamba架构在长序列建模中表现出显著优势。然而,高光谱数据的高维性和特征内联特性给Mamba的应用带来挑战。为此,我们提出全场交互多组Mamba框架(HS-Mamba),采用区别于像素块或整图处理的策略,融合两者优势。将图像分割为小块送入多组Mamba模块,结合位置信息感知空间与光谱域的局部内联特征;同时将整图输入轻量级注意力模块,增强全局特征表示能力。具体地,HS-Mamba包含双通道时空编码器(DCSS-encoder)和轻量级全局内联注意力(LGI-Att)分支。前者利用多组Mamba对非重叠块序列解耦建模局部特征;后者通过轻量压缩扩展注意力模块,捕捉未分割整图的空间与光谱全局特征。通过融合局部与全局特征,实现高精度分类。大量实验表明,所提HS-Mamba在四个基准高光谱图像数据集上均优于当前最优方法。

原文摘要 · Abstract (English)

Hyperspectral image (HSI) classification has been one of the hot topics in remote sensing fields. Recently, the Mamba architecture based on selective state-space models (S6) has demonstrated great advantages in long sequence modeling. However, the unique properties of hyperspectral data, such as high dimensionality and feature inlining, pose challenges to the application of Mamba to HSI classification. To compensate for these shortcomings, we propose an full-field interaction multi-groups Mamba framework (HS-Mamba), which adopts a strategy different from pixel-patch based or whole-image based, but combines the advantages of both. The patches cut from the whole image are sent to multi-groups Mamba, combined with positional information to perceive local inline features in the spatial and spectral domains, and the whole image is sent to a lightweight attention module to enhance the global feature representation ability. Specifically, HS-Mamba consists of a dual-channel spatial-spectral encoder (DCSS-encoder) module and a lightweight global inline attention (LGI-Att) branch. The DCSS-encoder module uses multiple groups of Mamba to decouple and model the local features of dual-channel sequences with non-overlapping patches. The LGI-Att branch uses a lightweight compressed and extended attention module to perceive the global features of the spatial and spectral domains of the unsegmented whole image. By fusing local and global features, high-precision classification of hyperspectral images is achieved. Extensive experiments demonstrate the superiority of the proposed HS-Mamba, outperforming state-of-the-art methods on four benchmark HSI datasets.

高光谱图像Mamba分类遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。