让大模型动态选择图视图进行推理,提升图数据分析能力
Agentic Graph Token Reasoning

- 模型每步自主选择图视图并实时生成对应文本编码
- 在7个图数据领域表现超越基线,零样本迁移无需微调
- 适合需要动态推理的图数据任务,如知识图谱问答
图结构广泛存在于科学与工业领域,从引用网络到商品共购买图。由于许多图节点包含丰富文本,越来越多研究将大语言模型(LLMs)应用于图分析。现有方法多采用静态单次方式生成图标记:预先编码某一固定图视图(如节点、k跳邻域或聚类),再输入模型,无法随推理过程调整。本文提出“代理式图标记推理”机制,将图标记生成融入推理流程本身。模型在每一步自主决定编码哪个图视图及粒度,由图编码器按需生成对应连续标记,并拼接到当前上下文。模型在动态生成的图标记空间中逐步推理,读取的标记依赖于推理路径。通过三阶段训练:(i) 自监督任务教会模型读取异构图标记,(ii) 带图标记一致性正则化的鲁棒轨迹训练,(iii) 偏好优化以奖励图标记证据与节点文本证据一致的推理路径。在七个图数据领域评估中,模型显著优于各类基线,并实现零样本跨域迁移,无需针对目标图微调。本工作推动基于大模型的图分析从静态编码迈向图原生代理范式。
原文摘要 · Abstract (English)
Graphs model relational data throughout science and industry, from citation networks to product co-purchase graphs. Because the nodes of many such graphs carry rich text, a growing line of work applies large language models (LLMs) to graph analysis. The most graph-native of these methods use graph tokens: a graph encoder compresses a graph view, such as a node, its k-hop neighbourhood, or a cluster, into a short block of continuous tokens that jointly encodes node attributes and topology and is read directly by the model. Existing methods, however, use graph tokens in a static single-shot manner: they encode one predefined graph view before the model has even seen the target and never revise it, leaving the model's step-by-step reasoning ability unused. We introduce agentic graph token reasoning, which recasts graph tokenization as part of the reasoning process itself. At each step, the model chooses which graph view to encode and at what granularity; a graph encoder is invoked on demand to materialise the corresponding graph tokens; and the resulting block is spliced into the running context. The model thus reasons step by step in the graph token space, and the tokens it reads are trajectory-dependent. We realise this with a three-stage training pipeline: (i) self-supervised tasks that teach the model to read heterogeneous graph tokens, (ii) a token-robust trajectory stage with a graph-token consistency regulariser, and (iii) preference optimisation that rewards trajectories in which the graph-token evidence and the node-text evidence agree. Across evaluations spanning seven graph domains, our models outperform a broad set of baselines by a large margin and transfer zero-shot to unseen domains without any per-target fine-tuning. More broadly, this work pushes LLM-based graph analysis from static graph-token encoders towards a graph-native agent paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。