通过动态调整分类边界,提升小样本增量学习中旧类与新类的平衡表现。
Sculpting Margin Penalty: Intra-Task Adapter Merging and Classifier Calibration for Few-Shot Class-Incremental Learning
- 在训练中引入双适配器机制,分别强化旧类区分度与新类泛化能力。
- 在增量阶段通过边缘惩罚校准分类器,清晰划分类别边界。
- 适用于数据受限场景,尤其适合需长期扩展的智能系统部署。
现实应用常面临数据隐私限制与高昂采集成本,使增量任务中充足训练数据的假设不切实际,导致类别增量学习性能显著下降。前向兼容学习在基础任务训练时预设未来任务需求,成为小样本类别增量学习(FSCIL)的有前景解决方案。然而,现有方法仍难以兼顾旧类判别力与新类泛化性,且增量阶段缺乏原始数据常导致类别间决策边界模糊。为此,我们提出SMP(Sculpting Margin Penalty),一种基于参数高效微调范式的新型FSCIL方法,在不同阶段战略性引入边缘惩罚。具体而言,提出边距感知的同任务适配器合并(MIAM)机制用于基础任务学习:训练两组低秩适配器,分别采用带边缘惩罚与无边缘约束的分类损失,以增强旧类判别力和新类泛化性,并自适应融合以提升前向兼容性。在增量任务阶段,提出基于边缘惩罚的分类器校准(MPCC)策略,通过在所有已见类嵌入上微调分类器并施加边缘惩罚,优化决策边界。在CIFAR100、ImageNet-R和CUB200上的大量实验表明,SMP在FSCIL任务中达到当前最优性能,同时更好平衡旧类与新类的表现。
原文摘要 · Abstract (English)
Real-world applications often face data privacy constraints and high acquisition costs, making the assumption of sufficient training data in incremental tasks unrealistic and leading to significant performance degradation in class-incremental learning. Forward-compatible learning, which prospectively prepares for future tasks during base task training, has emerged as a promising solution for Few-Shot Class-Incremental Learning (FSCIL). However, existing methods still struggle to balance base-class discriminability and new-class generalization. Moreover, limited access to original data during incremental tasks often results in ambiguous inter-class decision boundaries. To address these challenges, we propose SMP (Sculpting Margin Penalty), a novel FSCIL method that strategically integrates margin penalties at different stages within the parameter-efficient fine-tuning paradigm. Specifically, we introduce the Margin-aware Intra-task Adapter Merging (MIAM) mechanism for base task learning. MIAM trains two sets of low-rank adapters with distinct classification losses: one with a margin penalty to enhance base-class discriminability, and the other without margin constraints to promote generalization to future new classes. These adapters are then adaptively merged to improve forward compatibility. For incremental tasks, we propose a Margin Penalty-based Classifier Calibration (MPCC) strategy to refine decision boundaries by fine-tuning classifiers on all seen classes' embeddings with a margin penalty. Extensive experiments on CIFAR100, ImageNet-R, and CUB200 demonstrate that SMP achieves state-of-the-art performance in FSCIL while maintaining a better balance between base and new classes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。