用大模型零样本标注节点,少花钱还更准。
Leveraging Large Language Models for Effective Label-free Node Classification in Text-Attributed Graphs
- 通过主动选择关键节点,减少对大模型的调用次数。
- 在DBLP数据集上比顶尖方法准确率高8.08%,成本不足1美分。
- 结合大模型与图神经网络,自动修正错误标签,适合低资源场景。
图神经网络(GNN)在图数据节点分类中表现优异,但依赖大量高质量标注数据,获取成本高。随着大语言模型(LLM)的发展,利用其零样本能力进行节点标注成为新方向。然而现有方法要么需频繁调用LLM,要么因生成噪声标签导致性能下降。为此,本文提出Locle:一种高效、无监督的节点分类自训练框架。Locle通过三个核心组件实现:(i) 初期有效主动选点策略;(ii) 基于标签不一致性和熵值的“关键”节点识别机制;(iii) 融合LLM与GNN并重构拓扑的标签优化模块。在五个基准文本属性图数据集上的实验表明,相同调用预算下,Locle显著优于现有最优方法。尤其在含14,300个节点的DBLP数据集上,准确率提升8.08%,总成本低于1美分。代码已开源。
原文摘要 · Abstract (English)
Graph neural networks (GNNs) have become the preferred models for node classification in graph data due to their robust capabilities in integrating graph structures and attributes. However, these models heavily depend on a substantial amount of high-quality labeled data for training, which is often costly to obtain. With the rise of large language models (LLMs), a promising approach is to utilize their exceptional zero-shot capabilities and extensive knowledge for node labeling. Despite encouraging results, this approach either requires numerous queries to LLMs or suffers from reduced performance due to noisy labels generated by LLMs. To address these challenges, we introduce Locle, an active self-training framework that does Label-free node Classification with LLMs cost-Effectively. Locle iteratively identifies small sets of "critical" samples using GNNs and extracts informative pseudo-labels for them with both LLMs and GNNs, serving as additional supervision signals to enhance model training. Specifically, Locle comprises three key components: (i) an effective active node selection strategy for initial annotations; (ii) a careful sample selection scheme to identify "critical" nodes based on label disharmonicity and entropy; and (iii) a label refinement module that combines LLMs and GNNs with a rewired topology. Extensive experiments on five benchmark text-attributed graph datasets demonstrate that Locle significantly outperforms state-of-the-art methods under the same query budget to LLMs in terms of label-free node classification. Notably, on the DBLP dataset with 14.3k nodes, Locle achieves an 8.08% improvement in accuracy over the state-of-the-art at a cost of less than one cent. Our code is available at https://github.com/HKBU-LAGAS/Locle.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。