arXiv:2410.01457cs.LG2024-10被引 4

用文字描述替代参数,让图模型全程可解释。

Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process

  • 全程用自然语言表示模型参数,实现完全可解释性。
  • 在多个任务上表现优于传统图神经网络,且决策透明。
  • 适合需要信任和透明度的医疗、金融等关键领域。

文本属性图(TAGs)上的表示学习因广泛的实际应用而受到关注,尤其通过图神经网络(GNN)实现。传统GNN方法主要编码图的结构信息,常使用浅层文本嵌入表示节点或边属性,限制了对数据中丰富语义的理解及复杂下游任务的推理能力,同时缺乏可解释性。随着大语言模型(LLMs)的兴起,越来越多研究将它们与GNN结合用于图表示学习和下游任务。尽管这些方法有效利用了标签数据中的丰富语义,但主要缺点是仅部分可解释,限制了在关键领域的应用。本文提出一种全可解释的言语化图表示学习(VGRL)方法。与通常在连续参数空间中优化的传统图机器学习模型不同,VGRL将参数空间约束为文本描述,确保整个过程的完全可解释性,使用户更容易理解并信任模型决策。我们通过多项实证研究评估了VGRL的有效性,认为该方法可作为图表示学习的奠基性进展。

原文摘要 · Abstract (English)

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the structural information of graphs, often using shallow text embeddings for node or edge attributes. This limits the model to understand the rich semantic information in the data and its reasoning ability for complex downstream tasks, while also lacking interpretability. With the rise of large language models (LLMs), an increasing number of studies are combining them with GNNs for graph representation learning and downstream tasks. While these approaches effectively leverage the rich semantic information in TAGs datasets, their main drawback is that they are only partially interpretable, which limits their application in critical fields. In this paper, we propose a verbalized graph representation learning (VGRL) method which is fully interpretable. In contrast to traditional graph machine learning models, which are usually optimized within a continuous parameter space, VGRL constrains this parameter space to be text description which ensures complete interpretability throughout the entire process, making it easier for users to understand and trust the decisions of the model. We conduct several studies to empirically evaluate the effectiveness of VGRL and we believe these method can serve as a stepping stone in graph representation learning.

图神经网络可解释性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。