arXiv:2505.12482cs.CV2025-05被引 3

通过时空自监督学习,提升高光谱图像少样本分类性能。

Spectral-Spatial Self-Supervised Learning for Few-Shot Hyperspectral Image Classification

论文配图:Spectral-Spatial Self-Supervised Learning for Few-Shot Hyperspectral Image Classification
图 1 · 摘自论文原文
  • 设计旋转翻转与掩码重建策略,分别学习空间几何与光谱依赖关系。
  • 在四个数据集上少样本分类准确率提升显著,最高达15.2%。
  • 适合需要小样本训练的高光谱遥感应用,如植被监测、矿产识别。

高光谱图像(HSI)的少样本分类面临标注样本稀缺的挑战。自监督学习(SSL)与少样本学习(FSL)为解决该问题提供了可行路径。然而,现有方法常难以适应HSI的空间几何多样性,且缺乏足够的光谱先验知识。为此,我们提出一种名为S4L-FSC的方法,旨在提升少样本HSI分类性能。具体而言,首先利用异构数据集,通过设计的旋转-翻转自监督学习(RM-SSL)与FSL联合预训练空间特征提取器,使模型通过旋转和翻转标签学习空间几何多样性,并通过少样本学习获得可迁移的空间元知识。随后,利用同质数据集,结合FSL与掩码重建自监督学习(MR-SSL)预训练光谱特征提取器,使模型从随机掩码的光谱向量中重建原始光谱信息,从而推断光谱依赖性;同时,FSL引导模型提取像素级判别特征,将丰富的光谱先验嵌入模型。该时空联合预训练策略结合异构与同质源知识,显著提升模型性能。在四个HSI数据集上的大量实验验证了S4L-FSC方法的有效性和优越性。

原文摘要 · Abstract (English)

Few-shot classification of hyperspectral images (HSI) faces the challenge of scarce labeled samples. Self-Supervised learning (SSL) and Few-Shot Learning (FSL) offer promising avenues to address this issue. However, existing methods often struggle to adapt to the spatial geometric diversity of HSIs and lack sufficient spectral prior knowledge. To tackle these challenges, we propose a method, Spectral-Spatial Self-Supervised Learning for Few-Shot Hyperspectral Image Classification (S4L-FSC), aimed at improving the performance of few-shot HSI classification. Specifically, we first leverage heterogeneous datasets to pretrain a spatial feature extractor using a designed Rotation-Mirror Self-Supervised Learning (RM-SSL) method, combined with FSL. This approach enables the model to learn the spatial geometric diversity of HSIs using rotation and mirroring labels as supervisory signals, while acquiring transferable spatial meta-knowledge through few-shot learning. Subsequently, homogeneous datasets are utilized to pretrain a spectral feature extractor via a combination of FSL and Masked Reconstruction Self-Supervised Learning (MR-SSL). The model learns to reconstruct original spectral information from randomly masked spectral vectors, inferring spectral dependencies. In parallel, FSL guides the model to extract pixel-level discriminative features, thereby embedding rich spectral priors into the model. This spectral-spatial pretraining method, along with the integration of knowledge from heterogeneous and homogeneous sources, significantly enhances model performance. Extensive experiments on four HSI datasets demonstrate the effectiveness and superiority of the proposed S4L-FSC approach for few-shot HSI classification.

高光谱少样本自监督遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。