让大模型主动找邻居,边推理边查证据。
Call Neighbours Yourself: Graph Walks with Destination-Conditioned On-Policy Self-Distillation

- 用图遍历动作动态选邻居,不预设上下文。
- 在标准数据集上超越固定上下文方法,提升显著。
- 探索策略可迁移到新图和未见任务,适合复杂推理场景。
文本属性图(TAGs)上的推理需要大语言模型(LLMs)结合节点文本与邻域中分散的证据。现有方法在生成前固定可访问邻居,迫使推理在静态上下文中进行,无法在推理过程中获取缺失证据。本文认为邻居选择本身应是推理过程的一部分。为此,提出 Call Neighbours Yourself(CNY)框架,使 LLM 能通过拓扑受限的图遍历动作主动探索邻域。不同于预选邻居集,CNY 提供轻量级邻居预览,并学习何时扩展候选邻居以获取更多证据。为解决邻居探索的延迟奖励问题,引入目标条件的在线自蒸馏机制,回溯评估选定邻居在内容揭示后的表现,将行动偏好变化转化为动作级训练信号。在统一原始文本设置下的标准 TAG 推理基准测试中,CNY 均一致优于固定上下文后训练基线。此外,学习到的探索策略可迁移至未见过的图以及训练中未出现的图级别任务。代码已开源。
原文摘要 · Abstract (English)
Reasoning over text-attributed graphs (TAGs) requires large language models (LLMs) to combine a node's text with evidence distributed across its neighbourhood. Existing methods fix the set of accessible neighbours before generation, forcing reasoning to operate over a static context and preventing the model from acquiring missing evidence during inference. We argue that neighbour selection should itself be part of the reasoning process. To this end, we propose Call Neighbours Yourself (CNY), a framework that enables LLMs to proactively explore graph neighbourhoods through topology-constrained graph-walk actions. Instead of reasoning over a pre-selected neighbour set, CNY exposes lightweight neighbour previews and learns when to expand candidate neighbours for additional evidence. To address the delayed-credit challenge of neighbour exploration, we introduce destination-conditioned on-policy self-distillation, which retrospectively evaluates a selected neighbour after its content is revealed and converts the resulting change in action preference into an action-level training signal. Experiments on standard TAG reasoning benchmarks under a unified raw-text setting show that CNY consistently outperforms fixed-context post-training baselines. Furthermore, the learned exploration policy transfers to unseen graphs and to a graph-level task not encountered during training. Code is available at https://github.com/superallen13/CNY.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。