arXiv:2412.08038cs.LGcs.CL2024-12AAAI被引 8

用大模型自动处理异构图数据,免去类型标注和预处理。

Bootstrapping Heterogeneous Graph Representation Learning via Large Language Models: A Generalized Approach

  • 用大模型自动识别节点和边的类型与格式
  • 无需预先知道类型信息,直接生成有效图表示
  • 适合处理任意格式的异构图数据,降低使用门槛

图表示学习在处理复杂非欧几里得数据方面表现出色,能捕捉图结构中的深层关系与特征。然而,传统方法在处理包含多种节点和边类型的异构图时面临挑战,因数据来源多样且结构复杂。现有异构图神经网络(HGNN)虽表现良好,但需依赖节点与边类型的先验知识及统一的特征格式,限制了其适用性。近期基于大语言模型(LLM)的图表示学习进展提供了新思路,利用LLM的数据处理能力实现不同图表示的对齐。但现有方法常忽视异构图特性,且需大量预处理。为此,本文提出一种新方法,结合LLM与GNN的优势,可直接处理任意格式、任意类型节点与边的图数据,无需类型信息或特殊预处理。该方法利用LLM自动总结并分类不同数据格式与类型,对齐节点特征,并通过专用GNN进行针对性学习,从而获得适用于下游任务的有效图表示。理论分析与实验验证均表明该方法有效。

原文摘要 · Abstract (English)

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with heterogeneous graphs that contain various types of nodes and edges due to the diverse sources and complex nature of the data. Existing Heterogeneous Graph Neural Networks (HGNNs) have shown promising results but require prior knowledge of node and edge types and unified node feature formats, which limits their applicability. Recent advancements in graph representation learning using Large Language Models (LLMs) offer new solutions by integrating LLMs' data processing capabilities, enabling the alignment of various graph representations. Nevertheless, these methods often overlook heterogeneous graph data and require extensive preprocessing. To address these limitations, we propose a novel method that leverages the strengths of both LLM and GNN, allowing for the processing of graph data with any format and type of nodes and edges without the need for type information or special preprocessing. Our method employs LLM to automatically summarize and classify different data formats and types, aligns node features, and uses a specialized GNN for targeted learning, thus obtaining effective graph representations for downstream tasks. Theoretical analysis and experimental validation have demonstrated the effectiveness of our method.

异构图大模型图神经网络自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。