arXiv:2410.11576cs.LGstat.ML2024-10中稿 · NeurlPS24

提出新方法同时提升模型对异常样本的敏感度与泛化能力。

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection

  • 从贝叶斯视角解耦不确定性学习目标,化解检测与泛化的矛盾。
  • 在标准数据集上实现顶尖检测性能,且噪声下分类准确率稳定。
  • 适合对模型可靠性要求高的真实场景应用,如医疗、自动驾驶。

分布外(OOD)检测对模型可信性至关重要,旨在敏感识别语义异常样本并稳健应对协变量偏移下的异常样本。然而我们发现,当前先进方法的优异表现是通过牺牲泛化能力换来的:即使引入轻微噪声,其分类精度也会急剧下降。这违背了模型可信性的初衷,严重限制了实际应用。本文从理论上揭示了现有方法中存在的“敏感-鲁棒”困境根源,并据此提出一种受理论启发的算法。通过从贝叶斯视角解耦不确定性学习目标,自然调和了检测与泛化之间的冲突,实现双重最优。实验证明,该方法在标准基准上表现卓越,据我们所知,这是首个在不损害泛化能力的前提下达到顶尖检测性能的原理性方法。代码已开源。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD detection performance of state-of-the-art methods is achieved by secretly sacrificing the OOD generalization ability. Specifically, the classification accuracy of these models could deteriorate dramatically when they encounter even minor noise. This phenomenon contradicts the goal of model trustworthiness and severely restricts their applicability in real-world scenarios. What is the hidden reason behind such a limitation? In this work, we theoretically demystify the ``\textit{sensitive-robust}'' dilemma that lies in many existing OOD detection methods. Consequently, a theory-inspired algorithm is induced to overcome such a dilemma. By decoupling the uncertainty learning objective from a Bayesian perspective, the conflict between OOD detection and OOD generalization is naturally harmonized and a dual-optimal performance could be expected. Empirical studies show that our method achieves superior performance on standard benchmarks. To our best knowledge, this work is the first principled OOD detection method that achieves state-of-the-art OOD detection performance without compromising OOD generalization ability. Our code is available at \href{https://github.com/QingyangZhang/DUL}{https://github.com/QingyangZhang/DUL}.

OOD检测模型可信贝叶斯方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。