通过多粒度关系对比学习,提升少样本分类的特征质量。
Rethinking the Sample Relations for Few-Shot Classification
- 区分三类样本关系:同一样本不同变换、同类别样本、异类别样本
- 在四个主流少样本基准上超越多数先进方法
- 可作为通用预训练模型,提升其他少样本方法性能
特征质量对分类性能至关重要,尤其在少样本场景中。对比学习通过利用样本间关系提取蕴含语义信息的内在特征,在少样本学习(FSL)中取得显著成功。然而,现有方法在处理不同粒度的样本关系时,采用统一建模方式,忽视了语义相似性的差异,限制了对比学习潜力。本文提出一种简单而有效的对比学习方法——多粒度关系对比学习(MGRCL),作为预训练特征学习模型,通过细致建模不同粒度的样本关系来提升少样本学习效果。MGRCL将样本关系分为三类:同一样本在不同变换下的内部关系、同类别样本的内部关系、异类别样本的外部关系。设计变换一致性学习(TCL)以确保样本在不同变换下的预测一致,保持语义一致性;同时采用类别对比学习(CCL)确保样本与同类样本更接近,与异类样本更远离,从而保留判别性信息。实验在四个主流FSL基准上验证,结果表明该方法优于多数领先方法。此外,该方法可作为预训练模型嵌入其他FSL方法,带来显著性能提升。
原文摘要 · Abstract (English)
Feature quality is paramount for classification performance, particularly in few-shot scenarios. Contrastive learning, a widely adopted technique for enhancing feature quality, leverages sample relations to extract intrinsic features that capture semantic information and has achieved remarkable success in Few-Shot Learning (FSL). Nevertheless, current few-shot contrastive learning approaches often overlook the semantic similarity discrepancies at different granularities when employing the same modeling approach for different sample relations, which limits the potential of few-shot contrastive learning. In this paper, we introduce a straightforward yet effective contrastive learning approach, Multi-Grained Relation Contrastive Learning (MGRCL), as a pre-training feature learning model to boost few-shot learning by meticulously modeling sample relations at different granularities. MGRCL categorizes sample relations into three types: intra-sample relation of the same sample under different transformations, intra-class relation of homogenous samples, and inter-class relation of inhomogeneous samples. In MGRCL, we design Transformation Consistency Learning (TCL) to ensure the rigorous semantic consistency of a sample under different transformations by aligning predictions of input pairs. Furthermore, to preserve discriminative information, we employ Class Contrastive Learning (CCL) to ensure that a sample is always closer to its homogenous samples than its inhomogeneous ones, as homogenous samples share similar semantic content while inhomogeneous samples have different semantic content. Our method is assessed across four popular FSL benchmarks, showing that such a simple pre-training feature learning method surpasses a majority of leading FSL methods. Moreover, our method can be incorporated into other FSL methods as the pre-trained model and help them obtain significant performance gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。