arXiv:2605.23797cs.LGcs.CV2026-05KDD被引 1

改进负样本挖掘,让预训练视觉语言模型更准识别未知输入。

Debiased Negative Mining Improves Out-of-distribution Detection with Pre-trained Vision-Language Models

论文配图:Debiased Negative Mining Improves Out-of-distribution Detection with Pre-trained Vision-Language Models
图 1 · 摘自论文原文
  • 通过理论修正负样本采样偏差,避免错误负例干扰检测。
  • 在多个数据集上实现新最优性能,显著提升未知类识别准确率。
  • 适合关注模型可靠性与鲁棒性的研究者和工业应用开发者。

为识别未知类别中的异常输入,分布外(OOD)检测已成为提升机器学习模型可靠性的关键方法。本文聚焦于基于预训练视觉语言模型(VLMs)的后处理式OOD检测范式,该范式通常通过分析已知类标签与负标签间的语义相似度来判断输入是否为分布外样本。由于缺乏目标分布外标签,现有方法多依赖启发式规则从无标签野数据中挖掘负标签。尽管效果良好,但文献中仍存在严重的假负例问题,制约了VLM在OOD检测中的潜力。为此,本文提出一种理论框架,通过间接逼近负标签分布来纠正其采样偏差。令人意外的是,该方法可自然转化为基于已知类标签与野数据的蒙特卡洛采样。大量实验表明,本方法在多种设置下均达到当前最优性能。代码已公开于GitHub。

原文摘要 · Abstract (English)

Aiming at identifying unexpected inputs from unknown classes, out-of-distribution (OOD) detection has emerged as a pivotal approach to enhancing the reliability of machine learning models. This paper focuses on the burgeoning paradigm of post-hoc OOD detection with pre-trained vision-language models (VLMs), where a popular pipeline is to detect OOD inputs by examining their affinities between ID labels and negative labels, i.e., those semantically different from ID labels. Due to the unavailability of target OOD labels, existing works predominantly rely on heuristic rules to mine negative labels from unlabeled wild corpus data. Despite the empirical success, we argue that the power of VLM-based OOD detection has yet to be fully unleashed since the notorious false negative problem is far from addressed in the literature. With this motivation, we are interested in addressing the challenge of mining true negative labels for OOD scoring. To this end, we develop a theoretical framework for correcting the sampling bias of negatives labels by indirectly approximating the distribution of negative labels. Perhaps surprisingly, we show that the debiased negative mining can be naturally converted into Monte-Carlo sampling based on ID labels and the unlabeled wild corpus data. Extensive experiments empirically manifest that our method establishes a new state-of-the-art in a variety of OOD detection setups. Code is publicly available at \href{https://github.com/60pen9/Debiased-Negative-Mining-Improves-OOD-Detection-with-Pre-trained-VLMs}{\textcolor{red}{here}}.

OOD检测视觉语言模型负样本挖掘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。