利用图像局部背景特征模拟异常数据,缓解模型对未知数据的过度自信。
Local Background Features Matter in Out-of-Distribution Detection
- 从正常数据中提取局部背景特征,作为训练时的假异常样本
- 通过最小化背景特征的L2范数,降低模型在未知数据上的置信度
- 兼容现有方法,实现在多个基准上的最新性能
在真实世界部署深度神经网络时,分布外(OOD)检测对于保障系统可靠性与安全性至关重要。其主要挑战在于模型对OOD数据常产生过度自信的预测。尽管一些基于辅助OOD数据集或生成假OOD图像的方法表现良好,但受限于数据收集与训练成本。本文提出一种新方法:利用正常数据中的局部背景特征作为模拟的OOD特征进行训练。受观察启发——OOD图像通常与ID图像共享相似背景区域——我们基于卷积的局部不变性,从ID图像中提取背景特征,并在训练中将其作为虚假的OOD视觉表征。通过优化使这些背景特征的L2范数最小化,神经网络得以缓解在OOD数据上的过自信问题。大量实验在多个标准OOD检测基准上验证了该方法的有效性,且具备广泛组合兼容性,结合现有后处理方法实现了新的最优性能。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) detection is crucial when deploying deep neural networks in the real world to ensure the reliability and safety of their applications. One main challenge in OOD detection is that neural network models often produce overconfident predictions on OOD data. While some methods using auxiliary OOD datasets or generating fake OOD images have shown promising OOD detection performance, they are limited by the high costs of data collection and training. In this study, we propose a novel and effective OOD detection method that utilizes local background features as fake OOD features for model training. Inspired by the observation that OOD images generally share similar background regions with ID images, the background features are extracted from ID images as simulated OOD visual representations during training based on the local invariance of convolution. Through being optimized to reduce the $L_2$-norm of these background features, the neural networks are able to alleviate the overconfidence issue on OOD data. Extensive experiments on multiple standard OOD detection benchmarks confirm the effectiveness of our method and its wide combinatorial compatibility with existing post-hoc methods, with new state-of-the-art performance achieved from our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。