提出更紧凑的特征表示,提升少样本增量学习的泛化与区分能力。
CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learning
- 在受限特征空间中紧致化类间特征,平衡迁移性与区分性。
- 在CIFAR-100和MiniImageNet上实现比现有方法更高的准确率。
- 挑战传统观点,证明类间距离越近越有利于少样本增量学习。
为在仅用少量样本的情况下持续学习新类别同时保留旧类别知识,少样本类增量学习(FSCIL)面临过拟合与灾难性遗忘等挑战。现有方法通常固定在基础类别上训练的特征提取器以减轻这些影响。本文聚焦于基础类别的表征学习,解决FSCIL的核心难题:如何同时实现表征的迁移性与区分性。基于提升迁移性的近期工作(如促进特征分散),我们发现,在更受约束的特征空间内保持特征紧凑反而能更好平衡迁移性与区分性。因此,与以往认为类间距离应最大化不同,我们主张:对FSCIL而言,不同类别间越接近越好。信息瓶颈理论视角下的实证结果与分析验证了这一看似反直觉但简洁有效的方法,引发新的研究思考并指向新方向。代码已公开于https://github.com/JungHunOh/CLOSER_ECCV2024。
原文摘要 · Abstract (English)
Aiming to incrementally learn new classes with only few samples while preserving the knowledge of base (old) classes, few-shot class-incremental learning (FSCIL) faces several challenges, such as overfitting and catastrophic forgetting. Such a challenging problem is often tackled by fixing a feature extractor trained on base classes to reduce the adverse effects of overfitting and forgetting. Under such formulation, our primary focus is representation learning on base classes to tackle the unique challenge of FSCIL: simultaneously achieving the transferability and the discriminability of the learned representation. Building upon the recent efforts for enhancing transferability, such as promoting the spread of features, we find that trying to secure the spread of features within a more confined feature space enables the learned representation to strike a better balance between transferability and discriminability. Thus, in stark contrast to prior beliefs that the inter-class distance should be maximized, we claim that the closer different classes are, the better for FSCIL. The empirical results and analysis from the perspective of information bottleneck theory justify our simple yet seemingly counter-intuitive representation learning method, raising research questions and suggesting alternative research directions. The code is available at https://github.com/JungHunOh/CLOSER_ECCV2024.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。