为少样本增量学习设计自适应分类边界,提升新旧类区分能力
Adaptive Decision Boundary for Few-Shot Class-Incremental Learning
- 为每类分配可动态调整的决策边界,优化分类空间
- 在三个数据集上显著提升性能,最高达8.3%准确率增益
- 适合需持续学习新类且样本稀缺的场景
少样本增量学习(FSCIL)旨在仅用少量样本持续学习新类别,同时不遗忘已有知识。传统方法在基础训练阶段使用丰富样本构建鲁棒特征提取器并冻结,仅微调分类器。然而现有策略主要关注防止灾难性遗忘,仅考虑新类与基类间关系,忽视各类具体决策空间。为此,我们提出即插即用的自适应决策边界策略(ADBS),兼容多数FSCIL方法。具体地,为每类分配特定决策边界,并在训练中自适应调整,以优化各会话中类别决策空间。此外,引入新颖的类间约束损失,优化各类的决策边界和原型,增强类别区分性。在CIFAR100、miniImageNet和CUB200三个基准上的大量实验表明,结合ADBS方法能显著提升现有FSCIL技术性能,实现整体最优结果。
原文摘要 · Abstract (English)
Few-Shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes from a limited set of training samples without forgetting knowledge of previously learned classes. Conventional FSCIL methods typically build a robust feature extractor during the base training session with abundant training samples and subsequently freeze this extractor, only fine-tuning the classifier in subsequent incremental phases. However, current strategies primarily focus on preventing catastrophic forgetting, considering only the relationship between novel and base classes, without paying attention to the specific decision spaces of each class. To address this challenge, we propose a plug-and-play Adaptive Decision Boundary Strategy (ADBS), which is compatible with most FSCIL methods. Specifically, we assign a specific decision boundary to each class and adaptively adjust these boundaries during training to optimally refine the decision spaces for the classes in each session. Furthermore, to amplify the distinctiveness between classes, we employ a novel inter-class constraint loss that optimizes the decision boundaries and prototypes for each class. Extensive experiments on three benchmarks, namely CIFAR100, miniImageNet, and CUB200, demonstrate that incorporating our ADBS method with existing FSCIL techniques significantly improves performance, achieving overall state-of-the-art results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。