arXiv:2412.15668cs.CV2024-12被引 16

通过分层图切割识别不同粒度的异常数据,提升模型在真实场景下的可靠性。

Adaptive Hierarchical Graph Cut for Multi-granularity Out-of-distribution Detection

  • 构建分层KNN图,基于语义相似性聚类图像,捕捉不同标签间的语义关联。
  • 在子图中按标签占比动态分配标签,对未标注样本实现更精准的归属判断。
  • 适用于多粒度标签场景,尤其适合跨数据集的异常检测任务。

本文针对一个关键但具有挑战性的任务——分布外检测(OOD detection),旨在识别并拒绝具有语义偏移的测试样本,防止基于分布内(ID)数据训练的模型产生不可靠预测。尽管已有方法取得一定进展,但在真实场景中仍表现不佳,因这些方法将所有未标注数据简单视为异常数据,忽视了不同数据集间标签粒度差异。例如,CIFAR-10中的“猫”与Tiny-ImageNet中的“虎斑猫”语义相同,却因标签粒度不同而被视为不同类别。为此,本文提出自适应分层图切割网络(AHGC),深入挖掘图像间的语义关系。具体而言,构建分层KNN图,基于余弦相似度评估图像间相似性;结合图的连通性和密度信息,将图切割为多个子图以整合语义相似样本。若某子图中标注样本比例超过阈值,则将占比最高的标签赋予未标注样本。为进一步提升泛化能力,对每张图像生成两个增强版本,并最大化二者之间的相似性。最终利用相似性得分进行分布外检测。在两个挑战性基准(CIFAR-10和CIFAR-100)上的大量实验表明,在代表性情况下,AHGC在FPR95指标上分别优于现有最先进方法81.24%(在CIFAR-100)和40.47%(在CIFAR-10),充分验证了AHGC的有效性。

原文摘要 · Abstract (English)

This paper focuses on a significant yet challenging task: out-of-distribution detection (OOD detection), which aims to distinguish and reject test samples with semantic shifts, so as to prevent models trained on in-distribution (ID) data from producing unreliable predictions. Although previous works have made decent success, they are ineffective for real-world challenging applications since these methods simply regard all unlabeled data as OOD data and ignore the case that different datasets have different label granularity. For example, "cat" on CIFAR-10 and "tabby cat" on Tiny-ImageNet share the same semantics but have different labels due to various label granularity. To this end, in this paper, we propose a novel Adaptive Hierarchical Graph Cut network (AHGC) to deeply explore the semantic relationship between different images. Specifically, we construct a hierarchical KNN graph to evaluate the similarities between different images based on the cosine similarity. Based on the linkage and density information of the graph, we cut the graph into multiple subgraphs to integrate these semantics-similar samples. If the labeled percentage in a subgraph is larger than a threshold, we will assign the label with the highest percentage to unlabeled images. To further improve the model generalization, we augment each image into two augmentation versions, and maximize the similarity between the two versions. Finally, we leverage the similarity score for OOD detection. Extensive experiments on two challenging benchmarks (CIFAR- 10 and CIFAR-100) illustrate that in representative cases, AHGC outperforms state-of-the-art OOD detection methods by 81.24% on CIFAR-100 and by 40.47% on CIFAR-10 in terms of "FPR95", which shows the effectiveness of our AHGC.

异常检测多粒度图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。