用最优传输方法提升零样本分布外检测能力
OT-DETECTOR: Delving into Optimal Transport for Zero-shot Out-of-Distribution Detection
- 引入跨模态传输质量和成本作为语义与分布差异度量
- 在硬分布外场景下准确率提升显著,超越现有方法
- 适合需要高可靠性模型的工业部署场景
分布外(OOD)检测对保障机器学习模型在真实应用中的可靠性和安全性至关重要。尽管基于视觉-语言模型如CLIP的零样本OOD检测已成现实,但现有方法主要依赖语义匹配,未能充分捕捉分布差异。为此,本文提出OT-DETECTOR框架,利用最优传输(OT)量化测试样本与正常数据标签之间的语义与分布差异。具体地,引入跨模态传输质量与传输成本分别作为语义级和分布级的OOD评分,实现更鲁棒的检测。此外,设计了语义感知内容优化(SaCR)模块,利用正常数据标签的语义线索增强正常与困难分布外样本间的分布差异。在多个基准上的大量实验表明,OT-DETECTOR在各类分布外检测任务中均达到领先性能,尤其在挑战性的硬分布外场景中表现优异。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) detection is crucial for ensuring the reliability and safety of machine learning models in real-world applications. While zero-shot OOD detection, which requires no training on in-distribution (ID) data, has become feasible with the emergence of vision-language models like CLIP, existing methods primarily focus on semantic matching and fail to fully capture distributional discrepancies. To address these limitations, we propose OT-DETECTOR, a novel framework that employs Optimal Transport (OT) to quantify both semantic and distributional discrepancies between test samples and ID labels. Specifically, we introduce cross-modal transport mass and transport cost as semantic-wise and distribution-wise OOD scores, respectively, enabling more robust detection of OOD samples. Additionally, we present a semantic-aware content refinement (SaCR) module, which utilizes semantic cues from ID labels to amplify the distributional discrepancy between ID and hard OOD samples. Extensive experiments on several benchmarks demonstrate that OT-DETECTOR achieves state-of-the-art performance across various OOD detection tasks, particularly in challenging hard-OOD scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。