通过优化聚类和语义注入,提升少样本学习中无标签数据的利用效率。
Semantic-Anchored, Class Variance-Optimized Clustering for Robust Semi-Supervised Few-Shot Learning
- 基于类别方差优化聚类,增强类别内紧凑性与类间分离性。
- 在基准数据集上显著超越现有最优方法,开放集设置下表现更优。
- 适合需要高鲁棒性的实际少样本场景,如跨域、有干扰类的任务。
少样本学习致力于解决某些类别标注样本极有限的问题。在半监督少样本学习设定下,存在大量无标签样本,其获取成本较低,可用于提升模型性能。近期部分方法依赖聚类生成无标签样本的伪标签。由于聚类效果直接影响伪标签质量,进而显著影响少样本学习性能,本文聚焦于优化模型表征以提升聚类效果。提出一种结合类别方差优化聚类与簇分离调优的方法,改进该设定下有标签与无标签样本的聚类能力。同时,采用受限伪标签策略优化伪标签生成过程,并引入语义信息注入,进一步提升模型在半监督少样本学习中的表现。实验表明,所提方法在基准数据集上显著优于当前最先进方法。为验证鲁棒性,还在挑战性条件下开展广泛实验,结果显示模型对领域迁移具有强泛化能力,在包含干扰类的开放集设置中达到新最优性能,凸显其在真实场景中的有效性。
原文摘要 · Abstract (English)
Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are available. Such unlabeled samples are generally cheaper to obtain and can be used to improve the few-shot learning performance of the model. Some of the recent methods for this setting rely on clustering to generate pseudo-labels for the unlabeled samples. Since the effectiveness of clustering heavily influences the labeling of the unlabeled samples, it can significantly affect the few-shot learning performance. In this paper, we focus on improving the representation learned by the model in order to improve the clustering and, consequently, the model performance. We propose an approach for semi-supervised few-shot learning that performs a class-variance optimized clustering coupled with a cluster separation tuner in order to improve the effectiveness of clustering the labeled and unlabeled samples in this setting. It also optimizes the clustering-based pseudo-labeling process using a restricted pseudo-labeling approach and performs semantic information injection in order to improve the semi-supervised few-shot learning performance of the model. We experimentally demonstrate that our proposed approach significantly outperforms recent state-of-the-art methods on the benchmark datasets. To further establish its robustness, we conduct extensive experiments under challenging conditions, showing that the model generalizes well to domain shifts and achieves new state-of-the-art performance in open-set settings with distractor classes, highlighting its effectiveness for real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。