提出轻量动态记忆变压器,提升高光谱图像分类精度与效率
Dynamic Memory Transformer for Hyperspectral Image Classification
- 引入动态记忆模块增强注意力机制,减少冗余计算
- 在印度果园区数据集上达99.55%整体准确率,优于主流方法
- 适合高光谱遥感、精细分类任务的研究者参考
高光谱图像分类(HSIC)需在标签数据有限、维度高的条件下有效建模复杂的空谱依赖关系。尽管基于Transformer的模型能捕捉长程上下文信息,但常产生冗余注意力模式,限制其对细粒度分析的效果。本文提出MemFormer,一种专用于HSIC的轻量级Transformer架构,引入动态记忆增强注意力机制,通过紧凑的全局记忆模块逐层聚合上下文信息,实现高效长程依赖建模并降低注意力冗余。此外,采用空谱位置嵌入(SSPE)联合编码空间连续性与光谱顺序,无需依赖卷积式位置编码即可获得结构一致的表示。在三个基准高光谱数据集(印度果园区、WHU-Hi-HanChuan、WHU-Hi-HongHu)上的大量实验表明,MemFormer性能优于代表性卷积、混合及Transformer方法。在印度果园区数据集上,整体准确率达99.55%,平均准确率为99.38%,κ系数为99.49%,验证了其在HSIC中的有效性与高效性。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) classification (HSIC) requires effective modeling of complex spatial-spectral dependencies under limited labeled data and high dimensionality. While transformer-based models have shown strong capability in capturing long-range contextual information, they often introduce redundant attention patterns, which limits their effectiveness for fine-grained HSI analysis. To address these challenges, this paper proposes MemFormer, a lightweight transformer architecture for HSIC that incorporates a dynamic memory-enhanced attention mechanism. The proposed design augments multi-head self-attention with a compact global memory module that progressively aggregates contextual information across layers, enabling efficient modeling of long-range dependencies while reducing attention redundancy. In addition, a Spatial-Spectral Positional Embedding (SSPE) is used to jointly encode spatial continuity and spectral ordering, providing structurally consistent representations without relying on convolution-based positional encodings. Extensive experiments conducted on three benchmark hyperspectral datasets, including Indian Pines, WHU-Hi-HanChuan, and WHU-Hi-HongHu, demonstrate that MemFormer achieves superior classification performance compared to representative convolutional, hybrid, and transformer-based methods. On the Indian Pines dataset, MemFormer attains an overall accuracy of up to 99.55\%, average accuracy of 99.38\%, and a $κ$ coefficient of 99.49\%, highlighting its effectiveness and efficiency for HSIC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。