arXiv:2410.20807cs.CV2024-10NeurIPS被引 11

解决长尾识别中异常检测的分布偏移问题,提升模型泛化能力。

Long-Tailed Out-of-Distribution Detection via Normalized Outlier Distribution Adaptation

  • 通过动态适应伪异常样本分布,逼近真实异常分布。
  • 提出双归一化能量损失,缓解长尾数据下的预测偏差。
  • 无需手动调参,在多个长尾基准上表现更优,适合长尾场景的异常检测。

在分布外(OOD)检测中,训练阶段缺乏真实OOD样本是主要挑战。一种有效方法是使用外部数据集样本作为伪OOD样本进行训练。然而,我们发现这些伪样本在长尾识别(LTR)场景下与真实OOD样本存在显著分布偏移,尤其体现在头部和尾部类别间的差异。为此,本文提出一种新方法——归一化异常分布自适应(AdaptOD),其核心是动态异常分布适应机制,利用推理时预测的异常样本中的知识,将原始异常分布调整为接近真实分布。此外,引入一种新型双归一化能量损失,通过类别和样本级能量归一化,使模型在长尾数据上的预测能量更均衡,避免对头部类别的偏好,从而学习到更优的初始异常分布。该方法无需人工调节敏感的边际超参数。在三个主流长尾识别的OOD检测基准上,AdaptOD均显著优于现有方法。代码已开源。

原文摘要 · Abstract (English)

One key challenge in Out-of-Distribution (OOD) detection is the absence of ground-truth OOD samples during training. One principled approach to address this issue is to use samples from external datasets as outliers (i.e., pseudo OOD samples) to train OOD detectors. However, we find empirically that the outlier samples often present a distribution shift compared to the true OOD samples, especially in Long-Tailed Recognition (LTR) scenarios, where ID classes are heavily imbalanced, \ie, the true OOD samples exhibit very different probability distribution to the head and tailed ID classes from the outliers. In this work, we propose a novel approach, namely normalized outlier distribution adaptation (AdaptOD), to tackle this distribution shift problem. One of its key components is dynamic outlier distribution adaptation that effectively adapts a vanilla outlier distribution based on the outlier samples to the true OOD distribution by utilizing the OOD knowledge in the predicted OOD samples during inference. Further, to obtain a more reliable set of predicted OOD samples on long-tailed ID data, a novel dual-normalized energy loss is introduced in AdaptOD, which leverages class- and sample-wise normalized energy to enforce a more balanced prediction energy on imbalanced ID samples. This helps avoid bias toward the head samples and learn a substantially better vanilla outlier distribution than existing energy losses during training. It also eliminates the need of manually tuning the sensitive margin hyperparameters in energy losses. Empirical results on three popular benchmarks for OOD detection in LTR show the superior performance of AdaptOD over state-of-the-art methods. Code is available at https://github.com/mala-lab/AdaptOD.

异常检测长尾识别分布外检测能量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。