arXiv:2412.10136cs.CLcs.AI2024-12NAACL被引 32

用大模型把普通图转成带文字描述的图,解决跨图学习难题。

Can LLMs Convert Graphs to Text-Attributed Graphs?

  • 用大模型结合图结构信息生成节点文字描述
  • 在无文本图上性能显著优于人工设计特征
  • 适合缺乏文本数据的图学习场景

图结构广泛存在于药物发现、推荐系统和社交网络分析等实际应用中。为建模图数据,图神经网络(GNN)已成为主流方法。然而,现有GNN架构在跨图学习中面临挑战,即多个图具有不同的特征空间。为此,近期方法引入了文本属性图(TAGs),将每个节点关联文本描述,并通过文本编码器投影到统一特征空间。尽管前景广阔,该方法依赖大量文本属性图数据,而这类数据在实践中难以获取。为此,我们提出一种新方法TANS(Topology-Aware Node description Synthesis),利用大语言模型(LLMs)将现有图转换为文本属性图。核心思想是将拓扑信息融入大模型,以解释图结构如何影响节点语义。我们在富含文本、文本有限和无文本图上评估TANS,证明其适用性。值得注意的是,在无文本图上,该方法显著优于现有手动设计节点特征的方法,展现出大模型在缺乏文本信息时预处理图数据的巨大潜力。代码与数据见https://github.com/Zehong-Wang/TANS。

原文摘要 · Abstract (English)

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool. However, existing GNN architectures encounter challenges in cross-graph learning where multiple graphs have different feature spaces. To address this, recent approaches introduce text-attributed graphs (TAGs), where each node is associated with a textual description, which can be projected into a unified feature space using textual encoders. While promising, this method relies heavily on the availability of text-attributed graph data, which is difficult to obtain in practice. To bridge this gap, we propose a novel method named Topology-Aware Node description Synthesis (TANS), leveraging large language models (LLMs) to convert existing graphs into text-attributed graphs. The key idea is to integrate topological information into LLMs to explain how graph topology influences node semantics. We evaluate our TANS on text-rich, text-limited, and text-free graphs, demonstrating its applicability. Notably, on text-free graphs, our method significantly outperforms existing approaches that manually design node features, showcasing the potential of LLMs for preprocessing graph-structured data in the absence of textual information. The code and data are available at https://github.com/Zehong-Wang/TANS.

图神经网络大模型文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。