用参数化图表示让大模型理解复杂图数据
What Do LLMs Need to Understand Graphs: A Survey of Parametric Representation of Graphs
- 提出用图定律参数描述图结构,便于大模型理解
- 统计真实图数据发现度数、直径等关键参数规律
- 适合需处理图数据的AI研究者与算法开发者
图作为关系型数据结构,广泛应用于分子设计和推荐系统等场景。近期大语言模型(LLMs)因其推理能力备受关注。让LLMs理解图数据具有巨大潜力,如在检索增强生成中引入外部知识库以减少幻觉、突破上下文窗口限制;或将图数据直接作为输入解决蛋白质设计、药物发现等任务。然而,由于图结构复杂、数据量大且缺乏有效的语义表示,直接输入全图不现实。一个核心问题浮现:是否存在一种可用自然语言描述、易于作为LLM输入的图表示?本文基于统计计算,提出图定律——通过观察大量真实图数据的拓扑分布,预定义一组参数(如度数、时间、直径),并识别其关系与取值。我们认为这类参数化图表示可成为使LLMs理解图数据的有效方案。本综述从宏观与微观视角、低阶与高阶图、静态与动态图、不同观测空间及新提出图参数等多个维度回顾图定律研究。随后总结其在实际应用中的价值,并指出当前挑战与未来方向。
原文摘要 · Abstract (English)
Graphs, as a relational data structure, have been widely used for various application scenarios, like molecule design and recommender systems. Recently, large language models (LLMs) are reorganizing in the AI community for their expected reasoning and inference abilities. Making LLMs understand graph-based relational data has great potential, including but not limited to (1) distillate external knowledge base for eliminating hallucination and breaking the context window limit for LLMs' inference during the retrieval augmentation generation process; (2) taking graph data as the input and directly solve the graph-based research tasks like protein design and drug discovery. However, inputting the entire graph data to LLMs is not practical due to its complex topological structure, data size, and the lack of effective and efficient semantic graph representations. A natural question arises: Is there a kind of graph representation that can be described by natural language for LLM's understanding and is also easy to require to serve as the raw input for LLMs? Based on statistical computation, graph laws pre-define a set of parameters (e.g., degree, time, diameter) and identifie their relationships and values by observing the topological distribution of plenty of real-world graph data. We believe this kind of parametric representation of graphs, graph laws, can be a solution for making LLMs understand graph data as the input. In this survey, we first review the previous study of graph laws from multiple perspectives, i.e., macroscope and microscope of graphs, low-order and high-order graphs, static and dynamic graphs, different observation spaces, and newly proposed graph parameters. After we review various real-world applications benefiting from the guidance of graph laws, we conclude the paper with current challenges and future research directions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。