提出轻量级适配器,解决少样本增量学习中新类混淆问题
CALA: A Class-Aware Logit Adapter for Few-Shot Class-Incremental Learning
- 通过伪增量学习训练适配器,动态修正分类器输出
- 在三个基准数据集上显著降低新类混淆率,提升分类准确率
- 可无缝接入主流方法,适合需要持续学习的场景
少样本增量学习(FSCIL)要求模型仅用少量样本持续学习新概念,但数据稀缺导致现有方法冻结主干网络后易过拟合于基础类别,造成新旧类别严重混淆。为此,本文提出类别感知的逻辑适配器(CALA),通过轻量级适配器在伪增量学习框架下学习修正偏差预测。在真实FSCIL过程中,该适配器动态生成鲁棒平衡因子,依据新类样本与基础类的相似度,将其从混淆空间调整回真实标签空间。当新类样本更接近基础类时,施加更大修正。CALA作用于分类器层面,不改变原始特征空间,可灵活集成至多数现有FSCIL方法中。在三个基准数据集上的实验一致验证了其有效性与通用性。代码将在录用后公开。
原文摘要 · Abstract (English)
Few-Shot Class-Incremental Learning (FSCIL) defines a practical but challenging task where models are required to continuously learn novel concepts with only a few training samples. Due to data scarcity, existing FSCIL methods resort to training a backbone with abundant base data and then keeping it frozen afterward. However, the above operation often causes the backbone to overfit to base classes while overlooking the novel ones, leading to severe confusion between them. To address this issue, we propose Class-Aware Logit Adapter (CALA). Our method involves a lightweight adapter that learns to rectify biased predictions through a pseudo-incremental learning paradigm. In the real FSCIL process, we use the learned adapter to dynamically generate robust balancing factors. These factors can adjust confused novel instances back to their true label space based on their similarity to base classes. Specifically, when confusion is more likely to occur in novel instances that closely resemble base classes, greater rectification is required. Notably, CALA operates on the classifier level, preserving the original feature space, thus it can be flexibly plugged into most of the existing FSCIL works for improved performance. Experiments on three benchmark datasets consistently validate the effectiveness and flexibility of CALA. Codes will be available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。