arXiv:2504.14704cs.LGcs.AI2025-04ICLR被引 2

揭示无标签OOD检测失效的理论根源,提出新评估任务

Can We Ignore Labels In Out of Distribution Detection?

  • 从信息论出发,发现标签盲视导致无标签OOD检测必然失败
  • 提出相邻OOD检测任务,揭露现有基准的安全漏洞
  • 实验证明现有方法在理论预测失效条件下全面失灵

近年来,分布外(OOD)检测在安全关键的自主系统中日益重要。其核心目标是识别可能导致不可预测错误的无效输入,以保障系统安全。由于标注数据成本高,近期研究探索了自监督学习、无标签及零样本OOD检测的可行性。本文从信息论角度,揭示了无标签OOD检测算法失效的一组理论条件:当学习目标与真实分布标签间互信息为零时,即存在‘标签盲视’,检测必然失败;提出新的OOD任务——相邻OOD检测,用于测试标签盲视问题,并填补现有基准忽视的安全空白;通过实验验证,现有无标签方法在理论预测失效条件下均表现不佳,揭示了未来研究的关键挑战。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection methods have recently become more prominent, serving as a core element in safety-critical autonomous systems. One major purpose of OOD detection is to reject invalid inputs that could lead to unpredictable errors and compromise safety. Due to the cost of labeled data, recent works have investigated the feasibility of self-supervised learning (SSL) OOD detection, unlabeled OOD detection, and zero shot OOD detection. In this work, we identify a set of conditions for a theoretical guarantee of failure in unlabeled OOD detection algorithms from an information-theoretic perspective. These conditions are present in all OOD tasks dealing with real-world data: I) we provide theoretical proof of unlabeled OOD detection failure when there exists zero mutual information between the learning objective and the in-distribution labels, a.k.a. 'label blindness', II) we define a new OOD task - Adjacent OOD detection - that tests for label blindness and accounts for a previously ignored safety gap in all OOD detection benchmarks, and III) we perform experiments demonstrating that existing unlabeled OOD methods fail under conditions suggested by our label blindness theory and analyze the implications for future research in unlabeled OOD methods.

OOD检测信息论安全评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。