用少量标注数据+无标签节点提升大模型在图文图上的推理能力
Semi-supervised Instruction Tuning for Large Language Models on Text-Attributed Graphs
- 通过迭代自训练,利用无标签节点的连接关系增强模型
- 在低标注率下性能提升超20%,显著优于传统方法
- 适用于社交网络等难以获取标注的场景
大型语言模型(LLM)的涌现推理能力为分析图文图提供了新范式。尽管指令微调是将预训练LLM适配到图学习任务(如节点分类)的主流方法,但需大量人工标注的(指令,输出)对,而社会领域中敏感或动态内容的专家标注成本高、速度慢。此外,标准图指令微调未利用大量无标签节点所蕴含的由边连接带来的潜在关联信息。为此,我们提出一种新型半监督图学习指令微调框架SIT-Graph。该方法模型无关,可无缝集成至任意基于LLM的图指令微调方法。SIT-Graph采用迭代自训练流程:先仅用有标签节点构建指令对进行微调;再生成置信度筛选后的伪响应用于无标签节点,以策略性扩充数据集并进入下一轮微调;最终通过迭代优化使LLM逐步捕捉节点间潜在关联。大量实验表明,当集成至现有先进图指令微调方法时,SIT-Graph在图文图基准上显著提升性能,在低标注率设置下实现超过20%的性能增益。
原文摘要 · Abstract (English)
The emergent reasoning capabilities of Large Language Models (LLMs) offer a transformative paradigm for analyzing text-attributed graphs. While instruction tuning is the prevailing method for adapting pre-trained LLMs to graph learning tasks like node classification, it requires a substantial volume of annotated (INSTRUCTION, OUTPUT) pairs deriving from labeled nodes. This requirement is particularly prohibitive in the social domain, where obtaining expert labels for sensitive or evolving content is costly and slow. Furthermore, standard graph instruction tuning fails to exploit the vast amount of unlabeled nodes, which contain latent correlations due to edge connections that are beneficial for downstream predictions. To bridge this gap, we propose a novel Semi-supervised Instruction Tuning pipeline for Graph Learning, named SIT-Graph. Notably, SIT-Graph is model-agnostic and can be seamlessly integrated into any graph instruction tuning method that utilizes LLMs as the predictor. SIT-Graph operates via an iterative self-training process. Initially, the model is fine-tuned using instruction pairs constructed solely from the labeled nodes. Then it generates confidence-filtered pseudo-responses for unlabeled nodes to strategically augment the dataset for the next round of fine-tuning. Finally, this iterative refinement progressively aligns the LLM with the underlying node correlations. Extensive experiments demonstrate that when incorporated into state-of-the-art graph instruction tuning methods, SIT-Graph significantly enhances their performance on text-attributed graph benchmarks, achieving over 20% improvement under the low label ratio settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。