基于最优传输理论的新型异常检测方法,提升模型对未知样本的识别能力。
Detecting OOD Samples via Optimal Transport Scoring Function
- 利用特征、输出和概率空间信息构建最优传输评分函数
- 在CIFAR-10上比当前最佳方法GEN提升7.19%(ResNet-18)
- 无需额外训练,适用于各类模型,适合部署阶段异常检测
为在真实场景中部署机器学习模型,研究者提出了多种分布外(OOD)检测算法,帮助模型在推理阶段识别未知样本,避免不可信预测。与依赖额外数据进行异常暴露训练的方法不同,后处理方法通过设计评分函数实现检测,具有模型无关性且无需额外训练。然而,以往后处理方法可能未能充分捕捉网络表征中的几何特征。为此,本文提出一种基于最优传输理论的新评分函数——OTOD,融合特征、logits和softmax概率空间信息计算每个测试样本的OOD得分。实验表明,结合多源信息可显著提升性能。在CIFAR-10和CIFAR-100基准上的实验显示,该方法表现优异:使用ResNet-18作为主干网络时,在CIFAR-10上比当前最优方法GEN的平均FPR@95提升7.19%;使用WideResNet-28时提升12.51%。此外,本文还提供了理论保证。代码已开源:https://github.com/HengGao12/OTOD。
原文摘要 · Abstract (English)
To deploy machine learning models in the real world, researchers have proposed many OOD detection algorithms to help models identify unknown samples during the inference phase and prevent them from making untrustworthy predictions. Unlike methods that rely on extra data for outlier exposure training, post hoc methods detect Out-of-Distribution (OOD) samples by developing scoring functions, which are model agnostic and do not require additional training. However, previous post hoc methods may fail to capture the geometric cues embedded in network representations. Thus, in this study, we propose a novel score function based on the optimal transport theory, named OTOD, for OOD detection. We utilize information from features, logits, and the softmax probability space to calculate the OOD score for each test sample. Our experiments show that combining this information can boost the performance of OTOD with a certain margin. Experiments on the CIFAR-10 and CIFAR-100 benchmarks demonstrate the superior performance of our method. Notably, OTOD outperforms the state-of-the-art method GEN by 7.19% in the mean FPR@95 on the CIFAR-10 benchmark using ResNet-18 as the backbone, and by 12.51% in the mean FPR@95 using WideResNet-28 as the backbone. In addition, we provide theoretical guarantees for OTOD. The code is available in https://github.com/HengGao12/OTOD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。