通过故意给野数据加噪声标签,实现无需阈值的异常检测。
LoD: Loss-difference OOD Detection by Intentionally Label-Noisifying Unlabeled Wild Data
- 故意给无标签野数据加噪声标签,让正常和异常数据共同主导模型学习。
- 利用损失差异区分正常与异常样本,使聚类可直接识别异常数据。
- 无需设定阈值,适合提升模型在真实场景下的安全性和可靠性。
使用包含分布内(ID)和分布外(OOD)数据的无标签野数据来提升模型的安全性与可靠性,正受到越来越多关注。现有方法要么为有标签的ID数据和无标签野数据设计定制损失并联合优化,要么先从野数据中过滤出OOD数据再训练检测器。尽管取得一定成效,但仍存在两个问题:(i) 有标签的ID数据通常主导模型学习,导致模型倾向于将OOD数据拟合为ID;(ii) 由于缺乏纯OOD样本,难以确定筛选OOD数据的阈值。为此,我们提出一种新型损失差分OOD检测框架(LoD),通过有意对无标签野数据进行标签噪声化处理。该操作不仅使有标签的ID数据与野数据中的OOD数据共同主导模型学习,还确保了野数据中ID与OOD样本损失的可区分性,从而可用经典聚类技术(如K-means)无需阈值即可过滤出这些异常样本。我们还为LoD的可行性提供了理论基础,大量实验验证了其优越性。
原文摘要 · Abstract (English)
Using unlabeled wild data containing both in-distribution (ID) and out-of-distribution (OOD) data to improve the safety and reliability of models has recently received increasing attention. Existing methods either design customized losses for labeled ID and unlabeled wild data then perform joint optimization, or first filter out OOD data from the latter then learn an OOD detector. While achieving varying degrees of success, two potential issues remain: (i) Labeled ID data typically dominates the learning of models, inevitably making models tend to fit OOD data as IDs; (ii) The selection of thresholds for identifying OOD data in unlabeled wild data usually faces dilemma due to the unavailability of pure OOD samples. To address these issues, we propose a novel loss-difference OOD detection framework (LoD) by \textit{intentionally label-noisifying} unlabeled wild data. Such operations not only enable labeled ID data and OOD data in unlabeled wild data to jointly dominate the models' learning but also ensure the distinguishability of the losses between ID and OOD samples in unlabeled wild data, allowing the classic clustering technique (e.g., K-means) to filter these OOD samples without requiring thresholds any longer. We also provide theoretical foundation for LoD's viability, and extensive experiments verify its superiority.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。