用强化学习让大模型自探索推理,实现可解释的时序图链接预测。
Self-Exploring Language Models for Explainable Link Forecasting on Temporal Graphs via Reinforcement Learning
- 通过奖励机制引导大模型从图结构中自生成推理策略。
- 在真实时序图上超越更大模型,在排名指标上表现更优。
- 支持对推理过程质量评估,适合需要可解释性的应用场景。
时序图链接预测是时序图推理的核心任务,需利用历史交互预测未来连接。传统神经方法虽性能强,但缺乏可解释性且无法直接用于未见图。近期研究尝试用大语言模型(LLM)进行图推理,但多数局限于静态图或小型合成数据集,且未评估模型生成推理路径的质量。本文提出面向时序图的推理增强学习框架ReaL-TG,通过基于结果的奖励机制,使微调后的LLM在真实时序图上实现可解释的链接预测。该框架鼓励模型自探索图结构中的推理模式,并生成直接支撑预测的解释。为评估生成推理轨迹质量,我们设计新评估协议:结合排名指标与以LLM为裁判的系统,综合判断推理质量与幻觉影响。基于我们的框架微调得到的ReaL-TG-4B(Qwen3-4B),在排名指标上优于更大型前沿模型(如GPT-5 mini),同时生成的解释经由LLM裁判和人工评估均证实质量高。
原文摘要 · Abstract (English)
Forecasting future links is a central task in temporal graph (TG) reasoning, requiring models to leverage historical interactions to predict upcoming ones. Traditional neural approaches, such as temporal graph neural networks, achieve strong performance but lack explainability and cannot be applied to unseen graphs without retraining. Recent studies have begun to explore using large language models (LLMs) for graph reasoning, but most of them are constrained to static graphs or small synthetic TGs and lack the evaluation of the quality of reasoning traces generated by LLMs. In this work, we present Reasoning-Enhanced Learning for Temporal Graphs (ReaL-TG), a reinforcement learning framework that fine-tunes LLMs to perform explainable link forecasting on real-world TGs. ReaL-TG uses outcome-based reward to encourage models to self-explore reasoning strategies from graph structure and to produce explanations that directly justify their predictions. To enable evaluation on LLM-generated reasoning traces, we propose a new evaluation protocol combining ranking metrics with an LLM-as-a-Judge system that assesses both the quality of reasoning and the impact of hallucinations. Experiments with ReaL-TG-4B, obtained by fine-tuning Qwen3-4B under our framework, show that it outperforms much larger frontier LLMs, including GPT-5 mini, on ranking metrics, while producing high-quality explanations confirmed by both the LLM judge and human evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。