EnergyFormer通过能量注意力与傅里叶嵌入,提升高光谱图像分类精度。
EnergyFormer: Energy Attention with Fourier Embedding for Hyperspectral Image Classification
- 用能量函数优化注意力,聚焦关键光谱空间特征。
- 在三个数据集上准确率超98.6%,最高达99.28%。
- 适合高光谱图像分类、遥感分析等需要精准识别的场景。
高光谱成像(HSI)在数百个连续波段上提供丰富的光谱-空间信息,适用于环境监测、农业和城市分析中的精确物质识别。然而,高维性和光谱可变性给特征提取与分类带来挑战。本文提出EnergyFormer,一种基于Transformer的框架,包含三项创新:(1)多头能量注意力(MHEA),通过优化能量函数选择性增强关键光谱-空间特征,提升特征区分能力;(2)傅里叶位置嵌入(FoPE),自适应编码光谱与空间依赖关系,强化长程交互;(3)增强卷积块注意力模块(ECBAM),选择性放大有信息量的波段与空间结构,增强表征学习。在WHU-Hi-HanChuan、Salinas和Pavia University数据集上的大量实验表明,EnergyFormer分别达到99.28%、98.63%和98.72%的卓越总体准确率,优于现有CNN、Transformer及Mamba模型。源代码将公开于https://github.com/mahmad000。
原文摘要 · Abstract (English)
Hyperspectral imaging (HSI) provides rich spectral-spatial information across hundreds of contiguous bands, enabling precise material discrimination in applications such as environmental monitoring, agriculture, and urban analysis. However, the high dimensionality and spectral variability of HSI data pose significant challenges for feature extraction and classification. This paper presents EnergyFormer, a transformer-based framework designed to address these challenges through three key innovations: (1) Multi-Head Energy Attention (MHEA), which optimizes an energy function to selectively enhance critical spectral-spatial features, improving feature discrimination; (2) Fourier Position Embedding (FoPE), which adaptively encodes spectral and spatial dependencies to reinforce long-range interactions; and (3) Enhanced Convolutional Block Attention Module (ECBAM), which selectively amplifies informative wavelength bands and spatial structures, enhancing representation learning. Extensive experiments on the WHU-Hi-HanChuan, Salinas, and Pavia University datasets demonstrate that EnergyFormer achieves exceptional overall accuracies of 99.28\%, 98.63\%, and 98.72\%, respectively, outperforming state-of-the-art CNN, transformer, and Mamba-based models. The source code will be made available at https://github.com/mahmad000.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。