提出T-CIL方法,在不依赖旧任务验证集情况下实现增量学习的置信度校准。
T-CIL: Temperature Scaling using Adversarial Perturbation for Calibration in Class-Incremental Learning
- 通过对抗扰动记忆样本,动态调整旧任务与新任务的扰动强度。
- 在真实数据集上显著提升校准性能,且对准确率影响极小。
- 适合需要高置信度可靠性的增量学习场景,如持续学习系统。
本文研究增量学习中的模型置信度校准问题,即模型在依次学习不同类别任务时保持合理的置信度。现有工作多关注准确性,而忽视了置信度校准。然而,多数后验校准方法需依赖旧任务的验证集,这在内存受限的增量学习中不现实。为此,我们提出T-CIL,一种无需旧任务验证集的温度缩放方法,利用记忆中样本的对抗扰动实现校准。由于原始记忆样本已用于训练,直接使用效果不佳。T-CIL的核心思想是:根据特征距离调整扰动方向,使旧任务的扰动强度大于新任务,并通过新任务验证集确定单一扰动幅度。该策略利用旧任务准确率普遍低于新任务的特性,使新任务计算出的扰动参数可有效应用于旧任务。实验表明,T-CIL在多个真实数据集上显著优于各类基线,在校准性方面表现优异,且与现有增量学习技术兼容,对准确率影响微小。
原文摘要 · Abstract (English)
We study model confidence calibration in class-incremental learning, where models learn from sequential tasks with different class sets. While existing works primarily focus on accuracy, maintaining calibrated confidence has been largely overlooked. Unfortunately, most post-hoc calibration techniques are not designed to work with the limited memories of old-task data typical in class-incremental learning, as retaining a sufficient validation set would be impractical. Thus, we propose T-CIL, a novel temperature scaling approach for class-incremental learning without a validation set for old tasks, that leverages adversarially perturbed exemplars from memory. Directly using exemplars is inadequate for temperature optimization, since they are already used for training. The key idea of T-CIL is to perturb exemplars more strongly for old tasks than for the new task by adjusting the perturbation direction based on feature distance, with the single magnitude determined using the new-task validation set. This strategy makes the perturbation magnitude computed from the new task also applicable to old tasks, leveraging the tendency that the accuracy of old tasks is lower than that of the new task. We empirically show that T-CIL significantly outperforms various baselines in terms of calibration on real datasets and can be integrated with existing class-incremental learning techniques with minimal impact on accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。