让大模型理解图的边结构,解决文本与图信息对不齐的问题。
Edge-Aware Curvature Modeling for Graph Understanding in Large Language Models

- 用边感知提示词让大模型直接生成带边信息的输出,无需训练参数
- 通过正曲率边传递消息,避免信息过压缩,提升跨模态对齐效果
- 适用于需要融合图结构和文本的任务,如知识图谱推理
近期图感知大语言模型在联合建模图结构数据与文本信息方面展现出潜力。现有方法多采用图编码器与冻结大模型,通过节点级对齐融合双模态信息,但忽视了边结构,导致跨视图信息传播效率低下。本文首次从理论上证明:忽略边信息会导致次优解,负曲率边引发信息流阻塞,造成过压缩现象。为此,提出CureLLM框架,通过无训练成本的文本提示机制注入边信息,并设计曲率感知图表示学习,仅允许正曲率边参与消息传递。在11个不同领域的实际数据集上,与20种方法对比,实验表明该框架显著优于现有方法。
原文摘要 · Abstract (English)
Recently, graph-aware Large Language Models (LLMs) have shown promising capabilities in jointly modeling graph-structured data and textual information. Existing approaches typically employ a graph encoder and a frozen LLM to obtain node representations from graph and textual views, followed by node-level alignment to bridge the two modalities. However, such alignment mechanisms primarily focus on node information while overlooking edge-level structures, leading to suboptimal information propagation across views. In this work, we conduct a comprehensive theoretical analysis to uncover why node-level alignment is insufficient for aligning textual and graph representations. Specifically, we prove theoretically for the first time that neglecting edge information leads to suboptimal solutions and negatively curved edges induce bottlenecked information flow, giving rise to the over-squashing phenomenon between graph and textual views. To address the two challenges, we innovatively proposed a CureLLM framework of Curvature-enhanced Graph Representations for Large Language Model whose goal is to inject the signals of edge information into the existing LLMs. Specifically, CureLLM first introduces the training-free textual prompt mechanism to make the LLM model generate the output directly based on the edge-aware prompt without learnable parameter costs. Furthermore, a novel curvature-aware graph representation learning is designed to capture the edge structure information to enhance the downstream tasks, where the message passing between text and graph representations only depends on edges with positive curvature. Finally, we conduct evaluations with 20 different compared methods on 11 real world datasets from various domains and the experiment results demonstrate the superiority of our proposed CureLLM framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。