提出可控遗忘机制,在少量新类别数据下提升模型表现同时减少旧类别遗忘。
Controllable Forgetting Mechanism for Few-Shot Class-Incremental Learning
- 通过新类别检测规则预先控制遗忘程度,平衡新旧类别学习。
- 在CIFAR100上实现1次采样下新类别准确率提升30%,旧类别遗忘率仅2%。
- 适用于极低样本场景,适合智能设备等个性化学习应用。
在少量个人标注样本(少样本)情境下的类增量学习对智能家居设备等实际应用至关重要。核心挑战在于如何在适应新个性化类别的同时,保持对原始基础类别的性能。对新类别进行微调常导致灾难性遗忘,使基础类别准确率显著且不可预测地下降。本文提出一种简单而有效的机制,通过控制新类别与基础类别准确率之间的权衡来应对该挑战。特别针对超低样本场景,即每类仅有一个样本的情况。我们的方法引入了新类别检测(NCD)规则,在预设条件下调整遗忘程度,同时提升新类别性能。我们通过将其应用于前沿的少样本类增量学习(FSCIL)方法,验证了方案的通用性,并在不同设置下均取得一致改进。为更精准量化新旧类别性能间的权衡,我们提出了新指标:NCR@2FOR 和 NCR@5FOR。在CIFAR100数据集上(1次采样,1个新类别),新类别准确率最高提升30%,同时基础类别遗忘率被严格控制在2%。
原文摘要 · Abstract (English)
Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challenge in these scenarios is balancing the trade-off between adapting to new, personalized classes and maintaining the performance of the model on the original, base classes. Fine-tuning the model on novel classes often leads to the phenomenon of catastrophic forgetting, where the accuracy of base classes declines unpredictably and significantly. In this paper, we propose a simple yet effective mechanism to address this challenge by controlling the trade-off between novel and base class accuracy. We specifically target the ultra-low-shot scenario, where only a single example is available per novel class. Our approach introduces a Novel Class Detection (NCD) rule, which adjusts the degree of forgetting a priori while simultaneously enhancing performance on novel classes. We demonstrate the versatility of our solution by applying it to state-of-the-art Few-Shot Class-Incremental Learning (FSCIL) methods, showing consistent improvements across different settings. To better quantify the trade-off between novel and base class performance, we introduce new metrics: NCR@2FOR and NCR@5FOR. Our approach achieves up to a 30% improvement in novel class accuracy on the CIFAR100 dataset (1-shot, 1 novel class) while maintaining a controlled base class forgetting rate of 2%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。