用大模型+小图神经网络,少标注就能高效识别异常图节点。
Few-Shot Graph Out-of-Distribution Detection with LLMs
- 先用大模型零样本筛选可疑异常点,大幅减少人工标注量。
- 仅对少量节点标注后训练轻量图网络,实现全图高效分类。
- 适合标注成本高、数据稀缺的文本属性图场景。
现有图异常检测方法依赖大量带标签的分布内(ID)数据训练图神经网络(GNN)分类器,但在文本属性图(TAGs)中获取高质量标签成本高昂,因其兼具复杂文本与结构特征。大语言模型(LLMs)虽具备强大的零样本文本处理能力,却难以自然捕捉图结构信息,限制其直接应用效果。为此,本文提出 LLM-GOOD 框架,融合 LLM 与 GNN 优势,提升图 OOD 检测的数据效率。首先利用 LLM 的零样本能力筛选可能的 OOD 节点,显著降低人工标注负担;仅对一小部分未标记节点使用 LLM 标注,再以这些噪声标签训练轻量级 GNN 过滤器,结合文本与结构信息,高效预测其余节点的 ID 状态。随后基于 GNN 输出的节点嵌入,采用基于信息量的方法选择最具价值节点进行精准人工标注,最终用准确标注的 ID 节点训练目标分类器。在四个真实世界 TAG 数据集上的实验表明,该方法显著降低人工标注成本,并在 ID 分类准确率和 OOD 检测性能上超越现有最优基线。
原文摘要 · Abstract (English)
Existing methods for graph out-of-distribution (OOD) detection typically depend on training graph neural network (GNN) classifiers using a substantial amount of labeled in-distribution (ID) data. However, acquiring high-quality labeled nodes in text-attributed graphs (TAGs) is challenging and costly due to their complex textual and structural characteristics. Large language models (LLMs), known for their powerful zero-shot capabilities in textual tasks, show promise but struggle to naturally capture the critical structural information inherent to TAGs, limiting their direct effectiveness. To address these challenges, we propose LLM-GOOD, a general framework that effectively combines the strengths of LLMs and GNNs to enhance data efficiency in graph OOD detection. Specifically, we first leverage LLMs' strong zero-shot capabilities to filter out likely OOD nodes, significantly reducing the human annotation burden. To minimize the usage and cost of the LLM, we employ it only to annotate a small subset of unlabeled nodes. We then train a lightweight GNN filter using these noisy labels, enabling efficient predictions of ID status for all other unlabeled nodes by leveraging both textual and structural information. After obtaining node embeddings from the GNN filter, we can apply informativeness-based methods to select the most valuable nodes for precise human annotation. Finally, we train the target ID classifier using these accurately annotated ID nodes. Extensive experiments on four real-world TAG datasets demonstrate that LLM-GOOD significantly reduces human annotation costs and outperforms state-of-the-art baselines in terms of both ID classification accuracy and OOD detection performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。