提出动态温度校准方法,让模型在增量学习中更准确地表达不确定性。
DATS: Distance-Aware Temperature Scaling for Calibrated Class-Incremental Learning
- 根据任务距离自适应调整温度,提升校准精度
- 在多个数据集上显著降低跨任务校准误差
- 适合对可靠性要求高的医疗等安全关键场景
持续学习(CL)使模型能从一系列新类别中逐步学习。在此场景下,需保持各类别预测性能稳定并防止灾难性遗忘。然而,在安全关键应用中,仅具备良好预测性能不足,模型还需以校准方式可靠表达不确定性——即置信度与真实事件频率一致。现有方法多从数据角度出发,使用单一温度,忽略任务差异,导致校准误差波动大。为此,本文提出距离感知温度校准(DATS),结合基于原型的距离估计与距离感知校准,无需任务信息即可推断任务接近度并分配自适应温度。在标准基准及生物医学领域的真实不平衡数据集上,实验表明该方法在减少跨任务校准误差方面优于现有最优方法,表现稳定可靠。
原文摘要 · Abstract (English)
Continual Learning (CL) is recently gaining increasing attention for its ability to enable a single model to learn incrementally from a sequence of new classes. In this scenario, it is important to keep consistent predictive performance across all the classes and prevent the so-called Catastrophic Forgetting (CF). However, in safety-critical applications, predictive performance alone is insufficient. Predictive models should also be able to reliably communicate their uncertainty in a calibrated manner - that is, with confidence scores aligned to the true frequencies of target events. Existing approaches in CL address calibration primarily from a data-centric perspective, relying on a single temperature shared across all tasks. Such solutions overlook task-specific differences, leading to large fluctuations in calibration error across tasks. For this reason, we argue that a more principled approach should adapt the temperature according to the distance to the current task. However, the unavailability of the task information at test time/during deployment poses a major challenge to achieve the intended objective. For this, we propose Distance-Aware Temperature Scaling (DATS), which combines prototype-based distance estimation with distance-aware calibration to infer task proximity and assign adaptive temperatures without prior task information. Through extensive empirical evaluation on both standard benchmarks and real-world, imbalanced datasets taken from the biomedical domain, our approach demonstrates to be stable, reliable and consistent in reducing calibration error across tasks compared to state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。