arXiv:2504.20509cs.CV2025-04中稿 · Information Fusion被引 24

MambaMoE通过专家机制提升高光谱图像分类精度与效率

MambaMoE: Mixture-of-Spectral-Spatial-Experts State Space Model for Hyperspectral Image Classification

  • 引入谱-空间专家混合框架,动态激活不同专家处理异质特征
  • 在多个公开数据集上达到当前最优准确率与计算效率
  • 适合关注高光谱图像分类中复杂区域建模的研究者

基于Mamba的模型在高光谱图像(HSI)分类中展现出显著潜力,主要因其具备线性复杂度的上下文建模能力。然而,现有Mamba方法常忽略不同地物类型间的方向建模差异,限制了分类性能。为此,我们提出MambaMoE,首个应用于HSI分类领域的混合专家(MoE)框架。设计了混合Mamba专家块(MoMEB),通过稀疏专家激活机制实现自适应谱-空间特征建模;同时引入不确定性引导修正学习(UGCL)策略,动态从预测不确定区域采样监督信号,引导模型自适应优化特征表示,强化对挑战性区域的关注。在多个公开HSI基准数据集上的实验表明,相比现有先进方法(特别是Mamba类方法),MambaMoE在分类准确率和计算效率方面均达到领先水平。代码将开源至https://github.com/YichuXu/MambaMoE。

原文摘要 · Abstract (English)

Mamba-based models have recently demonstrated significant potential in hyperspectral image (HSI) classification, primarily due to their ability to perform contextual modeling with linear computational complexity. However, existing Mamba-based approaches often overlook the directional modeling heterogeneity across different land-cover types, leading to limited classification performance. To address these limitations, we propose MambaMoE, a novel spectral-spatial Mixture-of-Experts (MoE) framework, which represents the first MoE-based approach in the HSI classification domain. Specifically, we design a Mixture of Mamba Expert Block (MoMEB) that performs adaptive spectral-spatial feature modeling via a sparse expert activation mechanism. Additionally, we introduce an uncertainty-guided corrective learning (UGCL) strategy that encourages the model to focus on complex regions prone to prediction ambiguity. This strategy dynamically samples supervision signals from regions with high predictive uncertainty, guiding the model to adaptively refine feature representations and thereby enhancing its focus on challenging areas. Extensive experiments conducted on multiple public HSI benchmark datasets show that MambaMoE achieves state-of-the-art performance in both classification accuracy and computational efficiency compared to existing advanced methods, particularly Mamba-based ones. The code will be available online at https://github.com/YichuXu/MambaMoE.

高光谱图像Mamba混合专家图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。