arXiv:2601.16098cs.CVcs.LG2026-01

用聚类引导的Mamba模型提升高光谱图像分类精度

Clustering-Guided Spatial-Spectral Mamba for Hyperspectral Image Classification

  • 通过聚类引导构建自适应令牌序列,压缩Mamba输入长度
  • 在三个数据集上准确率超越现有CNN、Transformer和Mamba方法
  • 适合需要精细边界保留的高光谱图像分析任务

尽管Mamba模型显著提升了高光谱图像(HSI)分类性能,但在定义高效且自适应的令牌序列方面仍存在关键挑战。本文提出CSSMamba(聚类引导的空间-光谱Mamba)框架以应对这一问题。首先,将聚类机制融入空间Mamba架构,设计出聚类引导的空间Mamba模块(CSpaMamba),有效缩短序列长度并增强特征学习能力。其次,将该模块与光谱Mamba模块(SpeMamba)结合,构建完整的聚类引导空间-光谱Mamba框架。第三,引入注意力驱动的令牌选择机制优化令牌排序。最后,设计可学习聚类模块,自适应地学习簇成员关系。在Pavia University、Indian Pines和Liao-Ning 01数据集上的实验表明,CSSMamba在分类准确率和边界保持方面均优于当前主流的CNN、Transformer和基于Mamba的方法。

原文摘要 · Abstract (English)

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba (Clustering-guided Spatial-Spectral Mamba) framework to better address the challenges, with the following contributions. First, to achieve efficient and adaptive token sequences for improved Mamba performance, we integrate the clustering mechanism into a spatial Mamba architecture, leading to a cluster-guided spatial Mamba module (CSpaMamba) that reduces the Mamba sequence length and improves Mamba feature learning capability. Second, to improve the learning of both spatial and spectral information, we integrate the CSpaMamba module with a spectral mamba module (SpeMamba), leading to a complete clustering-guided spatial-spectral Mamba framework. Third, to further improve feature learning capability, we introduce an Attention-Driven Token Selection mechanism to optimize Mamba token sequencing. Last, to seamlessly integrate clustering into the Mamba model in a coherent manner, we design a Learnable Clustering Module that learns the cluster memberships in an adaptive manner. Experiments on the Pavia University, Indian Pines, and Liao-Ning 01 datasets demonstrate that CSSMamba achieves higher accuracy and better boundary preservation compared to state-of-the-art CNN, Transformer, and Mamba-based methods.

高光谱图像Mamba模型聚类引导特征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。