融合两种距离度量,提升图像分类中异常数据检测的准确性。
COMBOOD: A Semiparametric Approach for Detecting Out-of-distribution Data for Image Classification
- 结合近邻与马氏距离信号,构建半参数检测框架
- 在远距离和近距离异常场景下均显著优于现有方法
- 计算高效可扩展,适合实际应用部署
在图像识别中,推理时检测分布外(OOD)数据对许多机器学习应用至关重要。本文提出一种新的无监督半参数框架COMBOOD,用于图像分类中的OOD检测。该框架融合最近邻与马氏距离两种度量信号,生成推理点为分布外的置信度分数。前者提供非参数化检测方式,后者虽简单有效但对近OOD场景表现不佳。COMBOOD在半参数设置下结合两者,在远距离和近距离异常场景中均取得高精度。实验表明,COMBOOD在OpenOOD(v1及v1.5)基准数据集及文档数据集上均超越当前最优方法,多数结果具有统计显著性。该方法在嵌入空间大小上呈线性增长,适合真实场景应用。
原文摘要 · Abstract (English)
Identifying out-of-distribution (OOD) data at inference time is crucial for many machine learning applications, especially for automation. We present a novel unsupervised semi-parametric framework COMBOOD for OOD detection with respect to image recognition. Our framework combines signals from two distance metrics, nearest-neighbor and Mahalanobis, to derive a confidence score for an inference point to be out-of-distribution. The former provides a non-parametric approach to OOD detection. The latter provides a parametric, simple, yet effective method for detecting OOD data points, especially, in the far OOD scenario, where the inference point is far apart from the training data set in the embedding space. However, its performance is not satisfactory in the near OOD scenarios that arise in practical situations. Our COMBOOD framework combines the two signals in a semi-parametric setting to provide a confidence score that is accurate both for the near-OOD and far-OOD scenarios. We show experimental results with the COMBOOD framework for different types of feature extraction strategies. We demonstrate experimentally that COMBOOD outperforms state-of-the-art OOD detection methods on the OpenOOD (both version 1 and most recent version 1.5) benchmark datasets (for both far-OOD and near-OOD) as well as on the documents dataset in terms of accuracy. On a majority of the benchmark datasets, the improvements in accuracy resulting from the COMBOOD framework are statistically significant. COMBOOD scales linearly with the size of the embedding space, making it ideal for many real-life applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。