arXiv:2410.16386cs.LGcs.SI2024-10被引 12

用少量标签实现图数据的未知类别识别,提升模型可靠性。

LEGO-Learn: Label-Efficient Graph Open-Set Learning

  • 基于GNN筛选潜在异常节点,再用K-Medoids选最有价值的标注样本。
  • 在4个真实数据集上,识别准确率提升6.62%,异常检测效果提高7.49%。
  • 适合标注成本高、需应对未知类别的金融、医疗等场景使用。

如何在低标注成本下训练图模型以识别未见类别?图开放集学习(GOL)与分布外(OOD)检测旨在训练模型,在准确分类已知分布内(ID)类别的同时,识别并处理推理中遇到的未知类别。这对金融、安全、医疗等高风险实际应用至关重要。然而,现有GOL方法依赖大量标注的ID样本,这在大规模图数据中不现实。本文提出LEGO-Learn(Label-Efficient Graph Open-set Learning),一种在给定标签预算下进行图开放集节点分类的新框架,通过选择最具信息量的ID节点来实现。LEGO-Learn采用基于GNN的过滤器排除潜在的OOD节点,并利用K-Medoids算法选取高度信息丰富的ID节点进行标注。为防止过滤器误删有价值的ID样本,引入一个包含C+1类的分类器,区分C个已知ID类与1个代表OOD的额外类,使用加权交叉熵损失,在移除OOD节点的同时保留关键的ID样本。在四个真实世界数据集上的实验表明,LEGO-Learn显著优于领先方法,ID分类准确率最高提升6.62%,OOD检测的AUROC提升7.49%。

原文摘要 · Abstract (English)

How can we train graph-based models to recognize unseen classes while keeping labeling costs low? Graph open-set learning (GOL) and out-of-distribution (OOD) detection aim to address this challenge by training models that can accurately classify known, in-distribution (ID) classes while identifying and handling previously unseen classes during inference. It is critical for high-stakes, real-world applications where models frequently encounter unexpected data, including finance, security, and healthcare. However, current GOL methods assume access to many labeled ID samples, which is unrealistic for large-scale graphs due to high annotation costs. In this paper, we propose LEGO-Learn (Label-Efficient Graph Open-set Learning), a novel framework that tackles open-set node classification on graphs within a given label budget by selecting the most informative ID nodes. LEGO-Learn employs a GNN-based filter to identify and exclude potential OOD nodes and then select highly informative ID nodes for labeling using the K-Medoids algorithm. To prevent the filter from discarding valuable ID examples, we introduce a classifier that differentiates between the C known ID classes and an additional class representing OOD nodes (hence, a C+1 classifier). This classifier uses a weighted cross-entropy loss to balance the removal of OOD nodes while retaining informative ID nodes. Experimental results on four real-world datasets demonstrate that LEGO-Learn significantly outperforms leading methods, with up to a 6.62% improvement in ID classification accuracy and a 7.49% increase in AUROC for OOD detection.

图神经网络开放集学习少样本标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。