在少样本增量学习中,重新训练全量数据更优,但需处理类别不平衡问题。
Does Prior Data Matter? Exploring Joint Training in the Context of Few-Shot Class-Incremental Learning
- 引入平衡缓解技术重构少样本增量学习的联合训练基准
- 实验显示联合训练在多数场景下优于仅用新数据更新
- 为实际应用提供可参考的训练策略选择依据
类别增量学习(CIL)旨在持续适应新类别的同时保留旧知识。少样本类别增量学习(FSCIL)要求模型仅用每类少量样本学习新类,挑战更大。尽管增量学习通常假设无法访问历史数据,但在许多真实场景中过去数据仍可获取。这引出关键问题:是否应基于完整数据集重新训练(联合训练),还是仅用新数据更新?在CIL中,联合训练是理想基准,用于权衡性能与计算成本。但在FSCIL中,因基础类与增量类间严重失衡,联合训练变得不可靠,导致缺乏实用基准,使实践者难以判断策略优劣。为此,本文在FSCIL背景下重新审视联合训练,结合失衡缓解技术,提出新的感知失衡的联合训练基准。通过大量对比分析该基准与现有FSCIL方法,揭示当历史数据可用时何种策略更合适。研究为真实世界FSCIL场景中的训练策略选择提供了切实洞见。代码已开源:https://github.com/shiwonkim/Joint_FSCIL
原文摘要 · Abstract (English)
Class-incremental learning (CIL) aims to adapt to continuously emerging new classes while preserving knowledge of previously learned ones. Few-shot class-incremental learning (FSCIL) presents a greater challenge that requires the model to learn new classes from only a limited number of samples per class. While incremental learning typically assumes restricted access to past data, it often remains available in many real-world scenarios. This raises a practical question: should one retrain the model on the full dataset (i.e., joint training), or continue updating it solely with new data? In CIL, joint training is considered an ideal benchmark that provides a reference for evaluating the trade-offs between performance and computational cost. However, in FSCIL, joint training becomes less reliable due to severe imbalance between base and incremental classes. This results in the absence of a practical baseline, making it unclear which strategy is preferable for practitioners. To this end, we revisit joint training in the context of FSCIL by incorporating imbalance mitigation techniques, and suggest a new imbalance-aware joint training benchmark for FSCIL. We then conduct extensive comparisons between this benchmark and FSCIL methods to analyze which approach is most suitable when prior data is accessible. Our analysis offers realistic insights and guidance for selecting training strategies in real-world FSCIL scenarios. Code is available at: https://github.com/shiwonkim/Joint_FSCIL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。