提出新方法提升模型对分布外样本的检测鲁棒性,解决自由能评分的固有缺陷。
FEVER-OOD: Free Energy Vulnerability Elimination for Robust Out-of-Distribution Detection
- 通过降维和正则化增强分类器最后一层的奇异值,减少自由能评分漏洞。
- 在ImageNet-100上实现35.83%的OOD误报率(95%真阳性率下),优于现有方法。
- 适合需要高可靠性开放集识别的场景,如自动驾驶、医疗诊断。
当前机器学习模型在图像分类与目标检测任务中表现优异,但在分布外(OOD)样本上常过度自信,导致开放环境下的行为不可预测。近期研究显示,自由能得分是衡量不确定性有效的指标,因其与数据分布密切相关。然而,我们的理论分析揭示了自由能评分形式中此前未被发现的内在缺陷:即使分布内与分布外样本的特征表示不同,也可能获得相同的自由能得分。这一现象发生在特征空间差异向量位于神经网络分类器最后一层的零空间时。为缓解此问题,我们探索低维特征空间以缩小零空间范围,并引入新型正则化,最大化最后一层线性层的最小奇异值,从而增强样本间自由能分离度。该方法称为稳健分布外检测的自由能漏洞消除(FEVER-OOD)。实验表明,结合基线Dream-OOD模型,FEVER-OOD在ImageNet-100上实现了平均OOD误报率35.83%(在95%真阳性率下)的最优性能。
原文摘要 · Abstract (English)
Modern machine learning models, that excel on computer vision tasks such as classification and object detection, are often overconfident in their predictions for Out-of-Distribution (OOD) examples, resulting in unpredictable behaviour for open-set environments. Recent works have demonstrated that the free energy score is an effective measure of uncertainty for OOD detection given its close relationship to the data distribution. However, despite free energy-based methods representing a significant empirical advance in OOD detection, our theoretical analysis reveals previously unexplored and inherent vulnerabilities within the free energy score formulation such that in-distribution and OOD instances can have distinct feature representations yet identical free energy scores. This phenomenon occurs when the vector direction representing the feature space difference between the in-distribution and OOD sample lies within the null space of the last layer of a neural-based classifier. To mitigate these issues, we explore lower-dimensional feature spaces to reduce the null space footprint and introduce novel regularisation to maximize the least singular value of the final linear layer, hence enhancing inter-sample free energy separation. We refer to these techniques as Free Energy Vulnerability Elimination for Robust Out-of-Distribution Detection (FEVER-OOD). Our experiments show that FEVER-OOD techniques achieve state of the art OOD detection in Imagenet-100, with average OOD false positive rate (at 95% true positive rate) of 35.83% when used with the baseline Dream-OOD model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。