arXiv:2506.00783cs.CLcs.AI2025-06被引 7

让大模型推理过程可解释且有据可查,提升可信度。

KG-TRACES: Enhancing Large Language Models with Knowledge Graph-constrained Trajectory Reasoning and Attribution Supervision

  • 用知识图谱约束推理路径,显式监督每一步逻辑
  • 在WebQSP和CWQ上分别提升4.7%和4.8%的准确率
  • 适合需要可信推理的医疗等专业领域应用

大语言模型在自然语言处理任务中表现卓越,但在复杂推理任务中仍受限于缺乏可解释性和可信度,常出现幻觉或无法溯源的推理过程。为此,我们提出KG-TRACES框架,通过显式监督推理路径与过程,增强大模型的推理能力。该框架联合监督模型:(1) 预测符号化关系路径,(2) 预测三元组级推理路径,(3) 生成基于推理路径的溯源感知推理过程。推理时,模型可在有知识图谱(KG)时检索路径,无时则仅依赖内部知识预测合理路径。在复杂推理任务上的实验表明,KG-TRACES显著优于现有最先进方法:在WebQSP上,Hits@1提升1.6%,F1提升4.7%;在CWQ上,Hits@1提升4.8%,F1提升2.1%。此外,其在医学等专业领域也具备良好迁移性。通过可视化中间推理步骤,进一步验证了显式监督使推理过程更稳定、目标导向,与正确答案高度一致。代码已开源。

原文摘要 · Abstract (English)

Large language models (LLMs) have made remarkable strides in various natural language processing tasks, but their performance on complex reasoning problems remains hindered by a lack of explainability and trustworthiness. This issue, often manifesting as hallucinations or unattributable reasoning processes, limits their applicability in complex reasoning scenarios. To address this, we propose Knowledge Graph-constrained Trajectory Reasoning Attribution and Chain Explanation Supervision (KG-TRACES), a novel framework that enhances the reasoning ability of LLMs through explicit supervision over reasoning paths and processes. KG-TRACES jointly supervises the model to: (1) predict symbolic relation paths, (2) predict full triple-level reasoning paths, and (3) generate attribution-aware reasoning processes grounded in the reasoning paths. At inference phase, the model adapts to both KG-available and KG-unavailable scenarios, retrieving reasoning paths from a KG when possible or predicting plausible reasoning paths with only intrinsic knowledge when not. This design enables the model to reason in an explainable and source-attributable pattern. Through extensive experiments on complex reasoning tasks, we demonstrate that KG-TRACES significantly outperforms existing SOTA: it improves Hits@1 by 1.6% and F1 by 4.7% on WebQSP, and achieves improvements of 4.8% in Hits@1 and 2.1% in F1 on CWQ. Moreover, we show its transferability to specialized domains such as medicine. By visualizing the intermediate steps of reasoning processes, we further show that the explicit supervision introduced by KG-TRACES leads to more stable and goal-directed reasoning processes, aligning closely with correct answers. Code is available at https://github.com/Edaizi/KG-TRACES.

知识图谱可解释性推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。