arXiv:2412.06642cs.CV2024-12被引 8

主动增量学习中,平衡类别选择能显著提升模型性能。

Class Balance Matters to Active Class-Incremental Learning

  • 通过聚类与高斯匹配策略,动态平衡未标注数据中的类别分布。
  • 在五个数据集上,该方法比随机采样和现有SOTA方法平均提升3.2%准确率。
  • 特别适合需要高效标注新类别的增量学习场景。

少样本增量学习在仅用少量标注数据学习新概念方面表现优异。然而,启发式少样本标注未必覆盖最具信息量的样本,限制了增量学习者的性能。本文提出主动增量学习(ACIL),从大规模未标注数据中选取最具信息量的样本进行标注,以提升增量学习模型性能。传统主动学习方法存在标注样本类别不平衡问题,为此我们提出类别平衡选择(CBS)策略:首先对所有未标注图像特征进行聚类,然后在每个簇内采用贪心策略,使所选样本的特征分布尽可能接近该簇整体的高斯分布。CBS可无缝集成至基于预训练模型与提示调优的增量学习方法中。在五个不同数据集上的大量实验表明,该方法在ACIL框架下优于随机采样及其他先进主动学习方法。代码已公开于https://github.com/1170300714/CBS。

原文摘要 · Abstract (English)

Few-Shot Class-Incremental Learning has shown remarkable efficacy in efficient learning new concepts with limited annotations. Nevertheless, the heuristic few-shot annotations may not always cover the most informative samples, which largely restricts the capability of incremental learner. We aim to start from a pool of large-scale unlabeled data and then annotate the most informative samples for incremental learning. Based on this premise, this paper introduces the Active Class-Incremental Learning (ACIL). The objective of ACIL is to select the most informative samples from the unlabeled pool to effectively train an incremental learner, aiming to maximize the performance of the resulting model. Note that vanilla active learning algorithms suffer from class-imbalanced distribution among annotated samples, which restricts the ability of incremental learning. To achieve both class balance and informativeness in chosen samples, we propose Class-Balanced Selection (CBS) strategy. Specifically, we first cluster the features of all unlabeled images into multiple groups. Then for each cluster, we employ greedy selection strategy to ensure that the Gaussian distribution of the sampled features closely matches the Gaussian distribution of all unlabeled features within the cluster. Our CBS can be plugged and played into those CIL methods which are based on pretrained models with prompts tunning technique. Extensive experiments under ACIL protocol across five diverse datasets demonstrate that CBS outperforms both random selection and other SOTA active learning approaches. Code is publicly available at https://github.com/1170300714/CBS.

增量学习主动学习类别平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。