通过微调原型提升少样本增量学习性能,只需少量参数。
Unlocking Prototype Potential: An Efficient Tuning Framework for Few-Shot Class-Incremental Learning
- 冻结特征提取器,只优化类原型以减少偏差。
- 双校准机制使原型具备类特定与任务感知能力。
- 参数极少却在多个基准上表现优异,适合资源受限场景。
少样本增量学习(FSCIL)旨在用极少量样本持续学习新类别,同时保留旧知识。传统方法使用冻结的预训练特征提取器生成静态类原型,易受主干网络固有表示偏差影响。近期提示调优方法虽通过少量参数更新适配主干,但在极端数据稀缺下,模型吸收新信息与增强全局判别力的能力仍受限。本文提出新视角:冻结特征提取器,仅微调原型。我们认为FSCIL的核心挑战并非特征获取,而是优化静态高质量特征空间中的决策区域。为此,我们提出一种高效的原型微调框架,将静态中心点转化为可学习的动态组件。该框架采用类特定与任务感知双校准机制,协同提升增量类的原型判别能力。大量实验表明,本方法在多个基准上表现更优,且所需可学习参数极少。
原文摘要 · Abstract (English)
Few-shot class-incremental learning (FSCIL) seeks to continuously learn new classes from very limited samples while preserving previously acquired knowledge. Traditional methods often utilize a frozen pre-trained feature extractor to generate static class prototypes, which suffer from the inherent representation bias of the backbone. While recent prompt-based tuning methods attempt to adapt the backbone via minimal parameter updates, given the constraint of extreme data scarcity, the model's capacity to assimilate novel information and substantively enhance its global discriminative power is inherently limited. In this paper, we propose a novel shift in perspective: freezing the feature extractor while fine-tuning the prototypes. We argue that the primary challenge in FSCIL is not feature acquisition, but rather the optimization of decision regions within a static, high-quality feature space. To this end, we introduce an efficient prototype fine-tuning framework that evolves static centroids into dynamic, learnable components. The framework employs a dual-calibration method consisting of class-specific and task-aware offsets. These components function synergistically to improve the discriminative capacity of prototypes for ongoing incremental classes. Extensive results demonstrate that our method attains superior performance across multiple benchmarks while requiring minimal learnable parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。