arXiv:2411.09250cs.CV2024-11中稿 · Neural Networks被引 1

提出新框架,让模型在少量样本下持续学新类且不遗忘旧类。

Embedding Space Allocation with Angle-Norm Joint Classifiers for Few-Shot Class-Incremental Learning

  • 用预设类别中心划分特征空间,为每轮新增类分配专属区域。
  • 结合角度与模长生成分类得分,提升小样本下的分类准确率。
  • 可直接嵌入现有方法,适合持续学习场景的系统优化。

少样本类增量学习(FSCIL)旨在仅用少量样本持续学习新类别,同时不遗忘旧类别,要求智能体适应动态环境。该任务融合了类增量学习与少样本学习的特点与挑战:(i) 已有类别占满特征空间,不利于新类别学习;(ii) 增量阶段样本过少,难以充分训练。现有主流虚拟类方法中,为解决挑战 (i),采用虚拟类作为占位符,但新类未必对齐虚拟类;为应对挑战 (ii),以基于余弦相似度的最近类别均值(NCM)分类器替代可训练全连接层,但未考虑样本不平衡问题。为此,本文提出类别中心引导的嵌入空间分配与角度-模长联合分类器(SAAN)框架,实现各类别间平衡的空间分配,并利用样本不平衡引发的模长差异增强分类判别能力。具体地,针对挑战 (i),SAAN通过预设类别中心将特征空间划分为多个子空间,为每轮会话分配专用子空间;针对挑战 (ii),SAAN为每类建立模长分布,生成角度-模长联合逻辑值。实验表明,SAAN达到当前最优性能,且可作为插件直接嵌入其他SOTA方法,进一步提升其表现。

原文摘要 · Abstract (English)

Few-shot class-incremental learning (FSCIL) aims to continually learn new classes from only a few samples without forgetting previous ones, requiring intelligent agents to adapt to dynamic environments. FSCIL combines the characteristics and challenges of class-incremental learning and few-shot learning: (i) Current classes occupy the entire feature space, which is detrimental to learning new classes. (ii) The small number of samples in incremental rounds is insufficient for fully training. In existing mainstream virtual class methods, for addressing the challenge (i), they attempt to use virtual classes as placeholders. However, new classes may not necessarily align with the virtual classes. For the challenge (ii), they replace trainable fully connected layers with Nearest Class Mean (NCM) classifiers based on cosine similarity, but NCM classifiers do not account for sample imbalance issues. To address these issues in previous methods, we propose the class-center guided embedding Space Allocation with Angle-Norm joint classifiers (SAAN) learning framework, which provides balanced space for all classes and leverages norm differences caused by sample imbalance to enhance classification criteria. Specifically, for challenge (i), SAAN divides the feature space into multiple subspaces and allocates a dedicated subspace for each session by guiding samples with the pre-set category centers. For challenge (ii), SAAN establishes a norm distribution for each class and generates angle-norm joint logits. Experiments demonstrate that SAAN can achieve state-of-the-art performance and it can be directly embedded into other SOTA methods as a plug-in, further enhancing their performance.

少样本学习增量学习分类器设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。