arXiv:2604.01763cs.CV2026-04

用角度相似性替代传统注意力,提升高光谱图像分类精度

Cosine-Normalized Attention for Hyperspectral Image Classification

  • 用余弦相似度计算注意力,聚焦特征方向而非大小
  • 在三组基准数据集上表现优于多个先进模型
  • 适合需要轻量高效分类的遥感图像应用

基于Transformer的方法通过建模长距离空间-光谱依赖关系,提升了高光谱图像分类(HSIC)性能;然而其注意力机制通常依赖点积相似性,会混合特征幅值与方向信息,对高光谱数据可能不够优。本文从几何视角重新审视注意力评分,提出一种余弦归一化注意力形式,使相似性计算更契合高光谱信号的角结构。通过将查询和键嵌入投影到单位超球面,并采用平方余弦相似度,该方法强调角度关系,降低对幅值变化的敏感性。该公式被集成至空间-光谱Transformer,在极低监督条件下进行评估。在三个基准数据集上的实验表明,所提方法持续取得更高性能,即使使用轻量骨干网络,也优于多个近期基于Transformer和Mamba的模型。此外,对多种注意力评分函数的控制分析显示,基于余弦的评分能为高光谱表示学习提供可靠归纳偏置。

原文摘要 · Abstract (English)

Transformer-based methods have improved hyperspectral image classification (HSIC) by modeling long-range spatial-spectral dependencies; however, their attention mechanisms typically rely on dot-product similarity, which mixes feature magnitude and orientation and may be suboptimal for hyperspectral data. This work revisits attention scoring from a geometric perspective and introduces a cosine-normalized attention formulation that aligns similarity computation with the angular structure of hyperspectral signatures. By projecting query and key embeddings onto a unit hypersphere and applying a squared cosine similarity, the proposed method emphasizes angular relationships while reducing sensitivity to magnitude variations. The formulation is integrated into a spatial-spectral Transformer and evaluated under extremely limited supervision. Experiments on three benchmark datasets demonstrate that the proposed approach consistently achieves higher performance, outperforming several recent Transformer- and Mamba-based models despite using a lightweight backbone. In addition, a controlled analysis of multiple attention score functions shows that cosine-based scoring provides a reliable inductive bias for hyperspectral representation learning.

高光谱图像注意力机制Transformer遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。