解决无样本增量学习中的语义漂移与分类偏倚问题
Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning
- 通过双投影机制捕捉任务与类别级语义漂移
- 用岭回归重构分类器,平衡新旧知识学习
- 在多个数据集上超越现有方法,适合持续学习研究者
无样本增量学习(EFCIL)旨在不保存样本的情况下顺序学习不同类别,但易发生灾难性遗忘。现有方法虽采用知识蒸馏缓解遗忘,仍面临语义漂移与决策偏倚两大挑战:旧任务嵌入在新任务学习后发生空间偏移,且分类器因仅用新数据训练而偏向新任务,难以平衡新旧知识。为此,本文提出双投影语义漂移估计与分类器重建(DPCR)方法。DPCR通过可学习变换与行空间投影结合,有效估计任务与类别级的语义漂移;同时利用岭回归重构分类器,基于校准后的类协方差与原型降低决策偏倚。大量实验表明,DPCR在多个数据集上均有效平衡新旧任务性能,优于当前最先进方法。代码已开源。
原文摘要 · Abstract (English)
Exemplar-Free Class-Incremental Learning (EFCIL) aims to sequentially learn from distinct categories without retaining exemplars but easily suffers from catastrophic forgetting of learned knowledge. While existing EFCIL methods leverage knowledge distillation to alleviate forgetting, they still face two critical challenges: semantic shift and decision bias. Specifically, the embeddings of old tasks shift in the embedding space after learning new tasks, and the classifier becomes biased towards new tasks due to training solely with new data, hindering the balance between old and new knowledge. To address these issues, we propose the Dual-Projection Shift Estimation and Classifier Reconstruction (DPCR) approach for EFCIL. DPCR effectively estimates semantic shift through a dual-projection, which combines a learnable transformation with a row-space projection to capture both task-wise and category-wise shifts. Furthermore, to mitigate decision bias, DPCR employs ridge regression to reformulate a classifier reconstruction process. This reconstruction exploits previous in covariance and prototype of each class after calibration with estimated shift, thereby reducing decision bias. Extensive experiments demonstrate that, on various datasets, DPCR effectively balances old and new tasks, outperforming state-of-the-art EFCIL methods. Our codes are available at https://github.com/RHe502/ICML25-DPCR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。