用三维傅里叶变换提升高光谱图像分类精度与效率
3D Fourier-based Global Feature Extraction for Hyperspectral Image Classification
- 结合3D卷积与频域滤波,同时捕捉局部结构与全局依赖
- 引入三种傅里叶变换,有效建模光谱-空间联合频率特征
- 适配类别不平衡场景,对稀有类别的识别能力显著增强
高光谱图像分类(HSIC)得益于深度学习对空间-光谱相关性的挖掘。然而,现有方法仍存在根本性局限:基于Transformer的模型因自注意力的二次复杂度导致可扩展性差;而近期基于傅里叶变换的方法多采用二维空间FFT,忽视了高光谱数据中关键的跨波段光谱依赖。为此,本文提出HGFNet,一种融合局部3D卷积与频域全局滤波的新型架构。HGFNet引入三种针对高光谱图像设计的互补傅里叶变换:沿光谱轴的1D FFT、空间维度的2D FFT,以及光谱-空间联合的3D FFT,实现高维频率建模。3D卷积层捕获精细局部空间-光谱结构,傅里叶滤波模块则高效建模长程依赖并抑制噪声。为缓解HSIC中常见的严重类别不平衡问题,HGFNet引入自适应焦点损失(AFL),动态调整类别聚焦与权重,增强对少数类的判别力。
原文摘要 · Abstract (English)
Hyperspectral image classification (HSIC) has been significantly advanced by deep learning methods that exploit rich spatial-spectral correlations. However, existing approaches still face fundamental limitations: transformer-based models suffer from poor scalability due to the quadratic complexity of self-attention, while recent Fourier transform-based methods typically rely on 2D spatial FFTs and largely ignore critical inter-band spectral dependencies inherent to hyperspectral data. To address these challenges, we propose Hybrid GFNet (HGFNet), a novel architecture that integrates localized 3D convolutional feature extraction with frequency-domain global filtering via GFNet-style blocks for efficient and robust spatial-spectral representation learning. HGFNet introduces three complementary frequency transforms tailored to hyperspectral imagery: Spectral Fourier Transform (a 1D FFT along the spectral axis), Spatial Fourier Transform (a 2D FFT over spatial dimensions), and Spatial-Spatial Fourier Transform (a 3D FFT jointly over spectral and spatial dimensions), enabling comprehensive and high-dimensional frequency modeling. The 3D convolutional layers capture fine-grained local spatial-spectral structures, while the Fourier-based global filtering modules efficiently model long-range dependencies and suppress noise. To further mitigate the severe class imbalance commonly observed in HSIC, HGFNet incorporates an Adaptive Focal Loss (AFL) that dynamically adjusts class-wise focusing and weighting, improving discrimination for underrepresented classes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。