arXiv:2603.24045cs.CV2026-03

提出动态路由的光谱空间专家模型,提升高光谱图像分类精度

LGEST: Dynamic Spatial-Spectral Expert Routing for Hyperspectral Image Classification

  • 用自动编码器压缩高维特征,保留空间结构
  • 跨注意力与专家混合机制动态融合多尺度信息
  • 按实时特征重要性选择卷积或注意力专家,适合复杂场景

深度学习方法在高光谱图像(HSI)分类中取得显著进展,但现有方法存在局部-全局表征融合僵化、异质波段间光谱-空间尺度差异处理不足,以及在高维样本异构下易受休斯现象影响的问题。为此,本文提出局部-全局专家空间-光谱变换器(LGEST),融合三项创新:首先,采用深层空间-光谱自编码器(DSAE)通过分层非线性压缩生成紧凑且具有判别性的嵌入,保持三维邻域一致性并减少高维空间中的信息损失;其次,设计交叉交互混合专家特征金字塔(CIEM-FPN),利用交叉注意力机制和残差专家混合层,通过可学习门控函数自适应加权光谱判别性与空间显著性,动态融合多尺度特征;最后,构建局部-全局专家系统(LGES),以稀疏激活的专家对处理分解特征:卷积子专家捕捉细粒度纹理,变压器子专家建模长程上下文依赖,路由控制器根据实时特征显著性动态选择专家。在四个基准数据集上的大量实验表明,LGEST持续优于当前最优方法。

原文摘要 · Abstract (English)

Deep learning methods, including Convolutional Neural Networks, Transformers and Mamba, have achieved remarkable success in hyperspectral image (HSI) classification. Nevertheless, existing methods exhibit inflexible integration of local-global representations, inadequate handling of spectral-spatial scale disparities across heterogeneous bands, and susceptibility to the Hughes phenomenon under high-dimensional sample heterogeneity. To address these challenges, we propose Local-Global Expert Spatial-Spectral Transformer (LGEST), a novel framework that synergistically combines three key innovations. The LGEST first employs a Deep Spatial-Spectral Autoencoder (DSAE) to generate compact yet discriminative embeddings through hierarchical nonlinear compression, preserving 3D neighborhood coherence while mitigating information loss in high-dimensional spaces. Secondly, a Cross-Interactive Mixed Expert Feature Pyramid (CIEM-FPN) leverages cross-attention mechanisms and residual mixture-of-experts layers to dynamically fuse multi-scale features, adaptively weighting spectral discriminability and spatial saliency through learnable gating functions. Finally, a Local-Global Expert System (LGES) processes decomposed features via sparsely activated expert pairs: convolutional sub-experts capture fine-grained textures, while transformer sub-experts model long-range contextual dependencies, with a routing controller dynamically selecting experts based on real-time feature saliency. Extensive experiments on four benchmark datasets demonstrate that LGEST consistently outperforms state-of-the-art methods.

高光谱图像专家路由Transformer特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。