arXiv:2502.07982cs.AI2025-02被引 8

用大模型增强节点语义,提升图学习性能

Deep Semantic Graph Learning via LLM based Node Enhancement

  • 用大模型生成文本节点的深层语义表示
  • 结合图Transformer捕捉局部与全局结构信息
  • 适用于需要理解复杂语义的图任务

图学习因其广泛的实际应用而受到关注。当前主流方法依赖文本节点特征,通过浅层嵌入学习(如GNN)获取初始节点表示,但在捕捉深层语义方面存在局限。大语言模型(LLMs)在理解文本语义方面展现出显著优势,可革新传统文本处理方式。本文提出一种新框架,将图Transformer与基于LLM增强的节点特征相结合。具体而言,利用LLM生成文本节点的丰富语义表示,并通过图Transformer中的多头自注意力机制,同时捕获局部与全局图结构信息。模型借助Transformer的注意力机制动态聚合邻域信息,同时保留LLM提供的语义丰富性。实验表明,采用LLM增强的节点特征显著提升了图学习模型在节点分类任务上的表现,在多个图学习任务中均取得良好效果,为图网络与语言模型的融合提供了实用方向。

原文摘要 · Abstract (English)

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs, which shows limitations in capturing deep textual semantics. Recent advances in Large Language Models (LLMs) have demonstrated superior capabilities in understanding text semantics, transforming traditional text feature processing. This paper proposes a novel framework that combines Graph Transformer architecture with LLM-enhanced node features. Specifically, we leverage LLMs to generate rich semantic representations of text nodes, which are then processed by a multi-head self-attention mechanism in the Graph Transformer to capture both local and global graph structural information. Our model utilizes the Transformer's attention mechanism to dynamically aggregate neighborhood information while preserving the semantic richness provided by LLM embeddings. Experimental results demonstrate that the LLM-enhanced node features significantly improve the performance of graph learning models on node classification tasks. This approach shows promising results across multiple graph learning tasks, offering a practical direction for combining graph networks with language models.

图学习大模型语义增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。