通过约束置信度差异提升分布外样本检测效果
Margin-bounded Confidence Scores for Out-of-Distribution Detection
- 在OE方法基础上增加边界约束,缩小类别内差异
- 使分布外样本置信度显著降低,提升检测准确率
- 适合对安全敏感的图像分类场景,如医疗诊断
在自动驾驶和医学图像诊断等关键机器学习应用中,检测分布外(OOD)样本与准确分类分布内(ID)样本同样重要。近年来基于异常暴露(OE)的方法通过使用额外异常数据微调模型,在检测OOD样本方面表现出色。然而,大多数现有方法更关注生成额外异常样本或引入正则化以扩大OOD样本空间,这些做法在实际中难以量化。本文提出一种新颖且直接的方法——边际有界置信度分数(MaCS),通过增大ID与OOD得分之间的差异,使决策边界更加紧凑,从而用简单阈值实现有效分离。具体地,我们在OE正则化分类器的学习目标中加入补充约束,惩罚对OOD输入的高置信度评分,相较于ID得分,显著提升OOD检测性能,同时保持ID分类准确率。在多个图像分类基准数据集上的大量实验表明,该方法在多种评估指标上显著优于当前最优(S.O.T.A)方法。代码已公开于 https://github.com/lakpa-tamang9/margin_ood。
原文摘要 · Abstract (English)
In many critical Machine Learning applications, such as autonomous driving and medical image diagnosis, the detection of out-of-distribution (OOD) samples is as crucial as accurately classifying in-distribution (ID) inputs. Recently Outlier Exposure (OE) based methods have shown promising results in detecting OOD inputs via model fine-tuning with auxiliary outlier data. However, most of the previous OE-based approaches emphasize more on synthesizing extra outlier samples or introducing regularization to diversify OOD sample space, which is rather unquantifiable in practice. In this work, we propose a novel and straightforward method called Margin bounded Confidence Scores (MaCS) to address the nontrivial OOD detection problem by enlarging the disparity between ID and OOD scores, which in turn makes the decision boundary more compact facilitating effective segregation with a simple threshold. Specifically, we augment the learning objective of an OE regularized classifier with a supplementary constraint, which penalizes high confidence scores for OOD inputs compared to that of ID and significantly enhances the OOD detection performance while maintaining the ID classification accuracy. Extensive experiments on various benchmark datasets for image classification tasks demonstrate the effectiveness of the proposed method by significantly outperforming state-of-the-art (S.O.T.A) methods on various benchmarking metrics. The code is publicly available at https://github.com/lakpa-tamang9/margin_ood
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。