提出自适应标签平滑,提升未知样本检测能力
Adaptive Label Smoothing for Out-of-Distribution Detection
- 根据置信度动态调整标签平滑强度,避免过度抑制最高概率
- 在6个数据集上实现已知/未知样本的清晰区分边界
- 适合需要高可靠性异常检测的工业场景
Out-of-distribution (OOD) 检测旨在区分未知类别与已知类别,近年来受到广泛关注。其主要挑战在于训练过程中无法获取未知类别的样本,因此有效策略是提升已知类别的分类性能。尽管数据增强和更长训练时间可改善效果,但标签平滑(label smoothing)虽有助于已知类别分类,却会降低 OOD 检测性能,这一现象尚未充分理解。本文首次分析指出:标签平滑中固定且有限的学习目标导致最大概率和 logit 值降低,从而恶化了 OOD 检测表现。为此,我们提出一种新正则化方法——自适应标签平滑(Adaptive Label Smoothing, ALS),核心思想是让非真实类别具有相同概率,而最大概率既不固定也不受限。在两个骨干网络、六个数据集上的大量实验表明,ALS 能同时提升已知样本分类准确率并增强对未知样本的辨别能力,实现清晰的置信度边界。代码将公开。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training process, and an effective strategy is to improve the performance for known classes. Using beneficial strategies such as data augmentation and longer training is thus a way to improve OOD detection. However, label smoothing, an effective method for classifying known classes, degrades the performance of OOD detection, and this phenomenon is under exploration. In this paper, we first analyze that the limited and predefined learning target in label smoothing results in the smaller maximal probability and logit, which further leads to worse OOD detection performance. To mitigate this issue, we then propose a novel regularization method, called adaptive label smoothing (ALS), and the core is to push the non-true classes to have same probabilities whereas the maximal probability is neither fixed nor limited. Extensive experimental results in six datasets with two backbones suggest that ALS contributes to classifying known samples and discerning unknown samples with clear margins. Our code will be available to the public.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。