融合卷积与注意力机制,提升高光谱图像分类精度。
CLAReSNet: When Convolution Meets Latent Attention for Hyperspectral Image Classification
- 用多尺度卷积+潜空间注意力,降低计算复杂度
- 在印度松和萨利纳斯数据集上准确率达99.71%和99.96%
- 适合处理小样本、类别不平衡的高光谱分类任务
高光谱图像(HSI)分类面临高维光谱、复杂光谱-空间关联及训练样本少、类别严重不均衡等挑战。尽管卷积神经网络擅长局部特征提取,变换器能捕捉长程依赖,但单独使用效果不佳,因存在二次复杂度且归纳偏置不足。本文提出CLAReSNet(卷积潜空间注意力残差光谱网络),融合多尺度卷积与类变换器注意力,通过自适应潜空间瓶颈实现高效建模。模型采用多尺度卷积主干与深度残差块,结合增强型卷积块注意力模块提取层次化空间特征;随后的光谱编码层融合双向RNN(LSTM/GRU)与多尺度光谱潜空间注意力(MSLA),将复杂度从$/mathcal{O}(T^2D)$降至$/mathcal{O}(T ext{log}(T)D)$,仅需8–64个潜变量,随序列长度对数增长。层级交叉注意力融合动态聚合多级表征,实现鲁棒分类。在Indian Pines与Salinas数据集上的实验表明,其整体准确率分别达99.71%和99.96%,显著优于HybridSN、SSRN和SpectralFormer。学习到的嵌入具有更强的类间可分性与紧凑的类内聚集性,验证了其在严重类别不均衡下的有效性。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) classification faces critical challenges, including high spectral dimensionality, complex spectral-spatial correlations, and limited training samples with severe class imbalance. While CNNs excel at local feature extraction and transformers capture long-range dependencies, their isolated application yields suboptimal results due to quadratic complexity and insufficient inductive biases. We propose CLAReSNet (Convolutional Latent Attention Residual Spectral Network), a hybrid architecture that integrates multi-scale convolutional extraction with transformer-style attention via an adaptive latent bottleneck. The model employs a multi-scale convolutional stem with deep residual blocks and an enhanced Convolutional Block Attention Module for hierarchical spatial features, followed by spectral encoder layers combining bidirectional RNNs (LSTM/GRU) with Multi-Scale Spectral Latent Attention (MSLA). MSLA reduces complexity from $\mathcal{O}(T^2D)$ to $\mathcal{O}(T\log(T)D)$ by adaptive latent token allocation (8-64 tokens) that scales logarithmically with the sequence length. Hierarchical cross-attention fusion dynamically aggregates multi-level representations for robust classification. Experiments conducted on the Indian Pines and Salinas datasets show state-of-the-art performance, achieving overall accuracies of 99.71% and 99.96%, significantly surpassing HybridSN, SSRN, and SpectralFormer. The learned embeddings exhibit superior inter-class separability and compact intra-class clustering, validating CLAReSNet's effectiveness under severe class imbalance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。