arXiv:2506.10508cs.CLcs.AI2025-06被引 17

用知识图谱生成可信推理路径,提升大模型问答能力

Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs

  • 结合大模型语义与图结构嵌入,挖掘可靠推理链
  • 在两个公开数据集上达到顶尖性能,优于现有方法
  • 可插即用,适合需要强逻辑推理的AI系统

大语言模型在知识密集型任务中常因背景知识不足和幻觉问题表现不佳。现有融合知识图谱(KG)的方法多聚焦补充事实知识,但对复杂问题仍难以有效求解。我们认为,理清事实间关系并构建逻辑一致的推理路径,与获取事实同等重要。然而,图结构复杂且生成路径多样,难以区分有用与冗余路径。为此,我们提出RRP框架,融合大模型语义能力与关系嵌入、双向分布学习的结构信息,并引入重思模块评估与优化推理路径。实验表明,RRP在两个公开数据集上达到当前最优性能,且可无缝集成至多种大模型中,以生成针对性高质量推理路径,为大模型推理提供有效引导。

原文摘要 · Abstract (English)

Large language models (LLMs) often struggle with knowledge-intensive tasks due to a lack of background knowledge and a tendency to hallucinate. To address these limitations, integrating knowledge graphs (KGs) with LLMs has been intensively studied. Existing KG-enhanced LLMs focus on supplementary factual knowledge, but still struggle with solving complex questions. We argue that refining the relationships among facts and organizing them into a logically consistent reasoning path is equally important as factual knowledge itself. Despite their potential, extracting reliable reasoning paths from KGs poses the following challenges: the complexity of graph structures and the existence of multiple generated paths, making it difficult to distinguish between useful and redundant ones. To tackle these challenges, we propose the RRP framework to mine the knowledge graph, which combines the semantic strengths of LLMs with structural information obtained through relation embedding and bidirectional distribution learning. Additionally, we introduce a rethinking module that evaluates and refines reasoning paths according to their significance. Experimental results on two public datasets show that RRP achieves state-of-the-art performance compared to existing baseline methods. Moreover, RRP can be easily integrated into various LLMs to enhance their reasoning abilities in a plug-and-play manner. By generating high-quality reasoning paths tailored to specific questions, RRP distills effective guidance for LLM reasoning.

知识图谱推理路径大模型逻辑推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。