解决无任务标识下的类别增量学习中语义漂移问题
Navigating Semantic Drift in Task-Agnostic Class-Incremental Learning
- 通过均值补偿与协方差校准缓解新旧类特征分布偏移
- 在CIFAR-100和ImageNet-100上实现优于现有方法的准确率
- 适合研究增量学习、模型稳定性与特征对齐的学者
类别增量学习(CIL)旨在让模型在不遗忘旧知识的前提下逐步学习新类别,但面对未知任务标识时,灵活性与稳定性难以兼顾。本文揭示新旧任务间特征分布差异主要源于均值与协方差的不一致。为此,提出一种语义漂移校准方法:通过平均样本嵌入计算类均值,并基于邻近度加权嵌入变化估计任务偏移,实现所有已学类别的均值补偿;同时引入马氏距离约束进行协方差校准,使旧网络与当前网络的类内嵌入协方差对齐,缓解协方差漂移;此外结合特征级自蒸馏增强泛化能力。在CIFAR-100和ImageNet-100等常用数据集上的大量实验表明,该方法显著优于现有方法。源代码已开源。
原文摘要 · Abstract (English)
Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task ID is unknown. To address this, our study reveals that the gap in feature distribution between novel and existing tasks is primarily driven by differences in mean and covariance moments. Building on this insight, we propose a novel semantic drift calibration method that incorporates mean shift compensation and covariance calibration. Specifically, we calculate each class's mean by averaging its sample embeddings and estimate task shifts using weighted embedding changes based on their proximity to the previous mean, effectively capturing mean shifts for all learned classes with each new task. We also apply Mahalanobis distance constraint for covariance calibration, aligning class-specific embedding covariances between old and current networks to mitigate the covariance shift. Additionally, we integrate a feature-level self-distillation approach to enhance generalization. Comprehensive experiments on commonly used datasets demonstrate the effectiveness of our approach. The source code is available at \href{https://github.com/fwu11/MACIL.git}{https://github.com/fwu11/MACIL.git}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。