通过扩展能量分布差距,提升少样本类别在未知样本检测中的准确率。
EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion
- 分离优化尾部真实样本与未知样本的能量得分
- 使尾部样本能量值显著高于未知样本,解决误判问题
- 适合多标签未知样本检测任务,尤其对长尾数据有效
多标签分布外(OOD)检测旨在区分多标签分布内(ID)样本与分布外样本。与单类情形相比,需建模类别间的联合信息。现有代表性方法JointEnergy综合所有类别输出,但存在不平衡问题,尤其当模型区分能力不足时,仅涉及少数类的样本易被误判为分布外。此外,原本为分布内设计的不平衡学习方法在分布外场景下会产生负面迁移。本文引入辅助异常暴露(OE),提出一种未知感知的多标签学习框架,重塑不确定性能量空间布局:分别优化尾部真实样本与未知样本的能量得分,并扩大二者间能量分布差距,使尾部样本能量值显著高于未知样本。同时设计简单有效的指标筛选更具信息量的OE数据集。在多个多标签和分布外数据集上的实验验证了方法的有效性。
原文摘要 · Abstract (English)
Multi-label Out-Of-Distribution (OOD) detection aims to discriminate the OOD samples from the multi-label In-Distribution (ID) ones. Compared with its multiclass counterpart, it is crucial to model the joint information among classes. To this end, JointEnergy, which is a representative multi-label OOD inference criterion, summarizes the logits of all the classes. However, we find that JointEnergy can produce an imbalance problem in OOD detection, especially when the model lacks enough discrimination ability. Specifically, we find that the samples only related to minority classes tend to be classified as OOD samples due to the ambiguous energy decision boundary. Besides, imbalanced multi-label learning methods, originally designed for ID ones, would not be suitable for OOD detection scenarios, even producing a serious negative transfer effect. In this paper, we resort to auxiliary outlier exposure (OE) and propose an unknown-aware multi-label learning framework to reshape the uncertainty energy space layout. In this framework, the energy score is separately optimized for tail ID samples and unknown samples, and the energy distribution gap between them is expanded, such that the tail ID samples can have a significantly larger energy score than the OOD ones. What's more, a simple yet effective measure is designed to select more informative OE datasets. Finally, comprehensive experimental results on multiple multi-label and OOD datasets reveal the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。