用物理中的福克空间编码图结构,无需训练就能让大模型理解图数据。
FoGE: Fock Space inspired encoding for graph prompting
- 基于数学物理的福克空间设计无参数图编码器,直接生成丰富图表示。
- 在简单图、蛋白质、超图等多类结构上均实现高效问答,无需调整架构。
- 适合想用预训练大模型处理图数据且不想调参的研究者或应用开发者。
近期研究表明,现代大语言模型(LLM)能够理解并回答关于图结构数据的问题。这一新范式可在减少监督的前提下实现良好泛化能力,支持回答训练标签之外的问题。现有方法通常通过图描述构建增强提示输入LLM;若为特定图类别部署定制化的图编码器,可与预训练LLM协同提升性能。当前方案包括图序列化和图变换器等。本文提出一种基于福克空间表示的无参数图编码器,源自数学物理理论,经少量调整后可为多种不同图提供丰富且信息量高的编码。我们将其用于前缀微调的提示框架,结合冻结的预训练LLM,使模型在简单图、蛋白质图、超图等多种图结构上均能有效回答问题,且几乎无需架构修改。该方法显著简化了现有方案,并对多类图结构具有强泛化能力。
原文摘要 · Abstract (English)
Recent results show that modern Large Language Models (LLM) are indeed capable of understanding and answering questions about structured data such as graphs. This new paradigm can lead to solutions that require less supervision while, at the same time, providing a model that can generalize and answer questions beyond the training labels. Existing proposals often use some description of the graph to create an ``augmented'' prompt fed to the LLM. For a chosen class of graphs, if a well-tailored graph encoder is deployed to play together with a pre-trained LLM, the model can answer graph-related questions well. Existing solutions to graph-based prompts range from graph serialization to graph transformers. In this work, we show that the use of a parameter-free graph encoder based on Fock space representations, a concept borrowed from mathematical physics, is remarkably versatile in this problem setting. The simple construction, inherited directly from the theory with a few small adjustments, can provide rich and informative graph encodings, for a wide range of different graphs. We investigate the use of this idea for prefix-tuned prompts leveraging the capabilities of a pre-trained, frozen LLM. The modifications lead to a model that can answer graph-related questions -- from simple graphs to proteins to hypergraphs -- effectively and with minimal, if any, adjustments to the architecture. Our work significantly simplifies existing solutions and generalizes well to multiple different graph-based structures effortlessly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。