用聚类引导的超连接机制提升高光谱图像分类准确率与可解释性。
mHC-HSI: Clustering-Guided Hyper-Connection Mamba for Hyperspectral Image Classification
- 基于聚类引导的Mamba模块，联合学习空间与光谱特征。
- 通过软聚类隶属图分解复杂数据，提升模型可解释性。
- 按物理意义分组光谱波段，增强方法的物理可解释性。
近期，DeepSeek提出了流形约束的超连接（mHC）方法，在深度学习模型中显著优于传统残差连接。然而该方法尚未针对高光谱图像（HSI）分类进行定制优化。本文提出一种聚类引导的mHC Mamba模型（mHC-HSI），以提升HSI分类性能。首先，为改善空间-光谱特征学习，设计了一种基于mHC框架的新颖聚类引导Mamba模块，显式建模HSI中的空间与光谱信息。其次，为将复杂的异构HSI分解为更小的簇，提出mHC中残差矩阵的新实现方式，将其视为软聚类隶属图，从而增强mHC方法的可解释性。第三，为利用物理光谱知识，将光谱波段划分为具有物理意义的组别，并作为mHC中的“并行流”，使方法更具物理可解释性。在多个基准数据集上的实验表明，所提模型不仅提升了分类精度，还增强了模型可解释性。代码已开源：https://github.com/GSIL-UCalgary/mHC_HyperSpectral。
原文摘要 · Abstract (English)
Recently, DeepSeek has invented the manifold-constrained hyper-connection (mHC) approach which has demonstrated significant improvements over the traditional residual connection in deep learning models \cite{xie2026mhc}. Nevertheless, this approach has not been tailor-designed for improving hyperspectral image (HSI) classification. This paper presents a clustering-guided mHC Mamba model (mHC-HSI) for enhanced HSI classification, with the following contributions. First, to improve spatial-spectral feature learning, we design a novel clustering-guided Mamba module, based on the mHC framework, that explicitly learns both spatial and spectral information in HSI. Second, to decompose the complex and heterogeneous HSI into smaller clusters, we design a new implementation of the residual matrix in mHC, which can be treated as soft cluster membership maps, leading to improved explainability of the mHC approach. Third, to leverage the physical spectral knowledge, we divide the spectral bands into physically-meaningful groups and use them as the "parallel streams" in mHC, leading to a physically-meaningful approach with enhanced interpretability. The proposed approach is tested on benchmark datasets in comparison with the state-of-the-art methods, and the results suggest that the proposed model not only improves the accuracy but also enhances the model explainability. Code is available here: https://github.com/GSIL-UCalgary/mHC_HyperSpectral
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。