利用样本间关系提升长尾数据下的异常检测效果
Exploiting Inter-Sample Information for Long-tailed Out-of-Distribution Detection
- 构建图结构捕捉样本间关联,融合预训练特征与高斯化处理
- 在三个长尾数据集上显著降低误报率,提升尾部类别识别准确率
- 适合需要高可靠性异常检测的长尾视觉识别场景
检测分布外(OOD)数据对深度神经网络的安全部署至关重要。在长尾分布的内分布(ID)数据下,现有方法常导致高误报率和尾部类别识别准确率低。本文提出利用基于图的表示挖掘样本间关系,显著提升长尾视觉数据中的OOD检测性能。通过预训练模型的特征空间初始化图结构,并针对预训练与训练数据激活层分布差异,引入高斯化处理以缓解非标准正态分布偏差。随后使用图卷积网络(GCNs)优化初始图表示,获得适用于长尾OOD检测的特征空间。该方法有效解决现有方法在尾部类别上的表现不佳问题。在CIFAR10-LT、CIFAR100-LT和ImageNet-LT三个基准上,本方法在误报率和尾部类别识别准确率上均大幅优于现有最优方法。
原文摘要 · Abstract (English)
Detecting out-of-distribution (OOD) data is essential for safe deployment of deep neural networks (DNNs). This problem becomes particularly challenging in the presence of long-tailed in-distribution (ID) datasets, often leading to high false positive rates (FPR) and low tail-class ID classification accuracy. In this paper, we demonstrate that exploiting inter-sample relationships using a graph-based representation can significantly improve OOD detection in long-tailed recognition of vision datasets. To this end, we use the feature space of a pre-trained model to initialize our graph structure. We account for the differences between the activation layer distribution of the pre-training vs. training data, and actively introduce Gaussianization to alleviate any deviations from a standard normal distribution in the activation layers of the pre-trained model. We then refine this initial graph representation using graph convolutional networks (GCNs) to arrive at a feature space suitable for long-tailed OOD detection. This leads us to address the inferior performance observed in ID tail-classes within existing OOD detection methods. Experiments over three benchmarks CIFAR10-LT, CIFAR100-LT, and ImageNet-LT demonstrate that our method outperforms the state-of-the-art approaches by a large margin in terms of FPR and tail-class ID classification accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。