arXiv:2606.30291cs.AI2026-06

让图神经网络与大模型深度协作,提升文本图学习效果

PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning

论文配图:PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning
图 1 · 摘自论文原文
  • 用结构注意力与文本相似度联合选邻居,生成带上下文的提示
  • 在六个数据集上超越经典方法,在稀疏连接下表现更优
  • 适合需要跨任务、跨数据集泛化的图学习研究者

文本属性图(TAGs)将文本语义与图结构结合,是众多图学习任务的核心。现有融合方法多采用浅层单向流程,难以实现模态间深度交互,尤其在连接稀疏或跨图泛化时性能受限。为此,我们提出 PromptGNN-sim,一种支持双向结构-语义融合的 GNN-LLM 协同学习框架。该方法利用图注意力网络(GAT),通过结构注意力与文本相似度结合,选择具有语义意义的邻域。所选结构上下文用于生成结构感知提示,包括目标节点摘要、标签类别和相似邻居的关键词。训练时引入双向跨模态对比学习与交叉注意力,联合优化 GNN 与 LLM 模块。在 Cora、Pubmed、WikiCS 等六个公开数据集上的实验表明,PromptGNN-sim 在准确率、泛化能力及稀疏扰动鲁棒性方面均优于经典 GNN、LLM 及近期 GNN-LLM 融合方法,验证了结构-语义协同交互的有效性。

原文摘要 · Abstract (English)

Text-Attributed Graphs (TAGs) combine textual semantics with graph structure and are central to many graph learning tasks. However, existing fusion methods often treat text and structure as separate inputs in a shallow, one-way pipeline, which limits deep interaction between modalities and weakens performance under sparse connectivity or cross-graph generalisation. To address this issue, we propose PromptGNN-sim, a bi-directional structure-semantic fusion framework for collaborative GNN-LLM learning. PromptGNN-sim uses a Graph Attention Network (GAT) for semantically aware neighborhood selection by combining structural attention with textual similarity. The selected structural context is then used to generate structure-aware prompts for an LLM, including the target node summary, label categories, and representative keywords from similar neighbors. During training, bi-directional cross-modal contrastive learning and cross-attention are introduced to jointly optimize the GNN and LLM components. Experiments on six public datasets, including Cora, Pubmed, and WikiCS, evaluate accuracy, generalisation, and robustness under cross-task transfer, cross-dataset generalisation, and sparse perturbations. Results show that PromptGNN-sim outperforms classical GNNs, LLMs, and recent GNN-LLM fusion methods, demonstrating the effectiveness of interactive structure-semantic collaboration for text-attributed graph learning.

图神经网络大模型融合文本图学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。