arXiv:2410.18472cs.LG2024-10NeurIPS被引 17

通过输入扰动增强检测能力,让模型更准识别未知数据

What If the Input is Expanded in OOD Detection?

  • 对输入施加常见噪声,扩展特征表达维度
  • 发现异常数据在噪声下置信度显著下降,正常数据则保持稳定
  • 仅平均多组输入得分即可提升检测效果,适合部署于安全敏感场景

分布外(OOD)检测旨在识别来自未知类别的输入,对机器学习模型在开放世界中的可靠部署至关重要。现有方法通常聚焦于单个输入的判别性信息,隐含限制了其表示维度。本文提出新视角:在输入空间施加不同常见噪声以扩展表征。我们发现一种有趣现象——置信度突变:在噪声下,OOD数据的置信度显著降低,而ID数据因语义特征具备更强鲁棒性,置信度期望更高。基于此,我们提出新的评分方法CoVer,通过简单平均原始输入与多种扰动输入的得分,捕捉动态差异,使OOD与ID分布更易分离。大量实验与分析验证了CoVer的有效性。代码已公开于:https://github.com/tmlr-group/CoVer。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection aims to identify OOD inputs from unknown classes, which is important for the reliable deployment of machine learning models in the open world. Various scoring functions are proposed to distinguish it from in-distribution (ID) data. However, existing methods generally focus on excavating the discriminative information from a single input, which implicitly limits its representation dimension. In this work, we introduce a novel perspective, i.e., employing different common corruptions on the input space, to expand that. We reveal an interesting phenomenon termed confidence mutation, where the confidence of OOD data can decrease significantly under the corruptions, while the ID data shows a higher confidence expectation considering the resistance of semantic features. Based on that, we formalize a new scoring method, namely, Confidence aVerage (CoVer), which can capture the dynamic differences by simply averaging the scores obtained from different corrupted inputs and the original ones, making the OOD and ID distributions more separable in detection tasks. Extensive experiments and analyses have been conducted to understand and verify the effectiveness of CoVer. The code is publicly available at: https://github.com/tmlr-group/CoVer.

OOD检测置信度分析模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。