arXiv:2607.29592cs.CVcs.LG2026-07中稿 · oral presentation …

提出新方法缓解持续学习中分布外检测性能退化问题。

TOOD: Task-Aware Out-of-Distribution Score Calibration for Continual Learners

论文配图:TOOD: Task-Aware Out-of-Distribution Score Calibration for Continual Learners
图 1 · 摘自论文原文
  • 通过分解分类得分并利用回放缓冲区统计重校准,实现无需训练的后处理校准。
  • 发现分布外检测退化与任务分类性能无关,且存在置信度差距和流形拥挤两种机制。
  • 在多个数据集上显著提升分布外检测效果,尤其在置信度差距严重时表现突出。

持续学习系统的主要挑战是在学习新任务的同时保持对旧任务的性能。然而,一个同样重要但研究较少的问题是系统区分来自已遇任务集合之外输入的能力,即分布外(OOD)检测。本文揭示了持续学习中OOD检测动态、性能退化的根源——我们称之为OOD遗忘(OODF),并提出了缓解策略。关键发现包括:OODF与旧任务分类性能弱负相关,表明其机制独立;能量基与特征基检测方法均受此影响。能量基检测因学习新任务导致logit尺度下降(置信度差距),特征基检测则出现流形拥挤。为此,我们提出TOOD,一种无需训练的后处理方法,将logits分解为各任务能量得分,并基于回放缓冲区统计进行重校准。在CIFAR-10、CIFAR-100和100个任务的ImageNet-1K流上实验表明,TOOD在多数设置下优于未校准的能量基方法,在十个CIFAR配置中九次位列第一或第二,尤其在置信度差距最严重时提升最大。结果表明,持续学习中大部分OOD性能下降源于得分校准失准,而非判别结构完全丧失。

原文摘要 · Abstract (English)

The primary challenge of continual learning (CL) systems is to learn new tasks while remaining performant on previously learned tasks. A similarly important though less well-studied aspect of CL systems is their ability to distinguish inputs that are unlikely to come from within the set of tasks the system has already encountered, often called out-of-distribution (OOD) detection. This paper presents several findings related to the dynamics of OOD detection in CL systems, causes of performance degradation over time which we call OOD forgetting (OODF), and proposed mitigation strategies for this degradation. Chiefly, we find the unintuitive result that OODF is only weakly anti-correlated with classification performance on previous tasks, suggesting that the underlying mechanisms producing OODF are distinct. Moreover, this effect is observed for both energy-based and feature-based OOD detection methods. Energy-based detectors suffer a drop in logit scale as additional tasks are learned, which we term the Confidence Gap, while feature-based detectors also degrade under a complementary effect we call Manifold Crowding. Motivated by these observations, we propose TOOD, a training-free post-hoc method that decomposes logits into per-task energy scores and re-calibrates them using replay-buffer statistics. Experiments on CIFAR-10, CIFAR-100, and a 100-task ImageNet-1K stream show that TOOD improves OOD detection performance over uncalibrated energy in most settings and ranks first or second in nine of ten CIFAR configurations, with the largest gains when the confidence gap is most severe. These results suggest that a substantial portion of OOD deterioration in continual learning arises from score miscalibration rather than from a complete loss of discriminative structure.

持续学习分布外检测模型校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。