用图结构自监督训练大模型,零标签下实现节点分类新高
HopRank: Self-Supervised LLM Preference-Tuning on Graphs for Few-Shot Node Classification
- 把节点分类转为链接预测,利用图拓扑构建无标签偏好数据
- 在三个基准上零标签训练,性能媲美全监督GNN
- 适合标签极少的学术、社交网络等场景
文本属性图(TAGs)上的节点分类是引文分析、社交网络和推荐系统中的基础任务。现有图神经网络方法存在文本编码浅、依赖大量标注数据的问题,难以应对标签稀缺场景。大语言模型(LLMs)虽具备深层语义理解能力,但现有图-LLM方法仍需大量标签或未能充分利用图结构信息。我们观察到,真实世界中多数图遵循同质性原则,边主要连接相似节点,因此图结构本身隐含类别信息。基于此,我们将节点分类重构为链接预测任务,提出完全自监督的LLM调优框架HopRank。HopRank通过分层跳数采样生成偏好数据,采用自适应偏好学习优先保留有效信号,无需任何类别标签。推理时,通过预测节点与已标注锚点的连接偏好进行分类,并引入自适应早停投票机制提升效率。在三个TAG基准测试中,尽管使用零标签训练,HopRank性能达到全监督GNN水平,显著优于先前图-LLM方法。
原文摘要 · Abstract (English)
Node classification on text-attributed graphs (TAGs) is a fundamental task with broad applications in citation analysis, social networks, and recommendation systems. Current GNN-based approaches suffer from shallow text encoding and heavy dependence on labeled data, limiting their effectiveness in label-scarce settings. While large language models (LLMs) naturally address the text understanding gap with deep semantic reasoning, existing LLM-for-graph methods either still require abundant labels during training or fail to exploit the rich structural signals freely available in graph topology. Our key observation is that, in many real-world TAGs, edges predominantly connect similar nodes under the homophily principle, meaning graph topology inherently encodes class structure without any labels. Building on this insight, we reformulate node classification as a link prediction task and present HopRank, a fully self-supervised LLM-tuning framework for TAGs. HopRank constructs preference data via hierarchical hop-based sampling and employs adaptive preference learning to prioritize informative training signals without any class labels. At inference, nodes are classified by predicting their connection preferences to labeled anchors, with an adaptive early-exit voting scheme to improve efficiency. Experiments on three TAG benchmarks show that HopRank matches fully-supervised GNNs and substantially outperforms prior graph-LLM methods, despite using zero labeled training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。