用对比学习提升低标签数据下高光谱图像分类效果
Enhancing Hyperspectral Image Prediction with Contrastive Learning in Low-Label Regime
- 两阶段训练:先用对比学习预训练编码器,再微调分类器
- 数据减半时仍优于全监督方法,多/单标签任务均有效
- 适合标注稀缺的遥感图像分析场景
自监督对比学习是应对标注数据有限的有效方法。本研究基于先前提出的两阶段像素级多标签分类方法,评估其在单标签和多标签分类任务中的表现,尤其在训练数据受限的情况下。方法分为两个阶段:首先利用对比学习训练编码器与投影网络,增强编码器从无标签数据中识别模式的能力;随后使用预训练编码器指导两个独立分类器(多标签与单标签)的训练。在四个公开数据集上的实证结果表明,该方法训练出的分类器性能优于全监督训练方式,即使训练数据减少50%也保持优势。该方法的优势源于其简洁架构,支持编码器与分类器联合重训练,使编码器更适应分类器所识别的特征,从而提升整体性能。定性分析显示,基于对比学习的编码器能生成可区分类别的表示,并捕捉位置相关特征,尽管未显式训练此类功能,表明其具备挖掘数据中隐含空间信息的潜力。
原文摘要 · Abstract (English)
Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for hyperspectral remote sensing imagery. We evaluate the method's performance for both the single-label and multi-label classification tasks, particularly under scenarios of limited training data. The methodology unfolds in two stages. Initially, we focus on training an encoder and a projection network using a contrastive learning approach. This step is crucial for enhancing the ability of the encoder to discern patterns within the unlabelled data. Next, we employ the pre-trained encoder to guide the training of two distinct predictors: one for multi-label and another for single-label classification. Empirical results on four public datasets show that the predictors trained with our method perform better than those trained under fully supervised techniques. Notably, the performance is maintained even when the amount of training data is reduced by $50\%$. This advantage is consistent across both tasks. The method's effectiveness comes from its streamlined architecture. This design allows for retraining the encoder along with the predictor. As a result, the encoder becomes more adaptable to the features identified by the classifier, improving the overall classification performance. Qualitative analysis reveals the contrastive-learning-based encoder's capability to provide representations that allow separation among classes and identify location-based features despite not being explicitly trained for that. This observation indicates the method's potential in uncovering implicit spatial information within the data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。