融合图结构与Mamba的模型提升高光谱图像分类效率
Hybrid State-Space and GRU-based Graph Tokenization Mamba for Hyperspectral Image Classification
- 用图结构生成并筛选关键空间-光谱标记,提升特征表达
- 结合状态空间与GRU,同时捕捉线性与非线性动态特性
- 计算量小适合小样本场景,适用于农业、环境监测等
高光谱图像(HSI)分类在环境监测、农业和城市规划等领域具有关键作用。然而,由于数据维度高及光谱-空间关系复杂,传统方法如机器学习和卷积神经网络(CNN)难以有效捕捉复杂的光谱-空间特征与全局上下文信息。基于Transformer的模型虽能建模长程依赖,但计算开销大,在标签数据有限的典型HSI应用中面临挑战。为此,本文提出GraphMamba,一种融合光谱-空间标记生成、图结构标记优先级排序与交叉注意力机制的混合模型。该模型创新性地结合状态空间建模与门控循环单元(GRU),同时捕捉线性与非线性空间-光谱动态。实验表明,GraphMamba在多种HSI数据集上优于现有最先进模型,具备良好的可扩展性与鲁棒性,为复杂HSI分类任务提供高效解决方案。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) classification plays a pivotal role in domains such as environmental monitoring, agriculture, and urban planning. However, it faces significant challenges due to the high-dimensional nature of the data and the complex spectral-spatial relationships inherent in HSI. Traditional methods, including conventional machine learning and convolutional neural networks (CNNs), often struggle to effectively capture these intricate spectral-spatial features and global contextual information. Transformer-based models, while powerful in capturing long-range dependencies, often demand substantial computational resources, posing challenges in scenarios where labeled datasets are limited, as is commonly seen in HSI applications. To overcome these challenges, this work proposes GraphMamba, a hybrid model that combines spectral-spatial token generation, graph-based token prioritization, and cross-attention mechanisms. The model introduces a novel hybridization of state-space modeling and Gated Recurrent Units (GRU), capturing both linear and nonlinear spatial-spectral dynamics. GraphMamba enhances the ability to model complex spatial-spectral relationships while maintaining scalability and computational efficiency across diverse HSI datasets. Through comprehensive experiments, we demonstrate that GraphMamba outperforms existing state-of-the-art models, offering a scalable and robust solution for complex HSI classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。