arXiv:2606.04454cs.CL2026-06

用外部知识图谱生成分步推理路径,提升大模型逻辑准确性和可解释性。

Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation

论文配图:Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation
图 1 · 摘自论文原文
  • 基于问题构建结构化查询模式,从知识图谱中检索相关子图作为推理依据。
  • 在多个基准数据集上,推理准确率和命中率均优于传统提示与现有增强方法。
  • 适合需要高可信度、可追溯推理过程的复杂问答场景使用。

大语言模型在自然语言生成和下游推理任务中表现强劲,但在复杂多步推理中仍存在逻辑一致性差、事实依据不足和可解释性弱的问题。为此,本文提出SGR框架,通过将大语言模型与外部知识图谱结合,实现分步推理增强。给定输入问题后,SGR首先提取关键实体、关系和约束,构建结构化查询模式,再基于该模式从知识图谱中检索紧凑的子图。生成的子图提供明确的关联证据,引导语言模型逐步推理。此外,SGR融合直接的Cypher推理与协作式答案整合机制,根据模型置信度和图谱一致性对多条推理路径的结果进行验证与聚合。在CWQ、WebQSP、GrailQA和KQA Pro等基准数据集上的实验表明,SGR在推理准确率和Hits@1性能上均优于标准提示法及多个知识增强基线。消融实验进一步证明,结构化查询引导与Neo4j检索是框架有效性的关键。结果表明,动态生成的外部子图能显著提升大模型推理的准确性、鲁棒性和可解释性。

原文摘要 · Abstract (English)

Large language models have shown strong performance in natural language generation and downstream reasoning tasks, but they still struggle with logical consistency, factual grounding, and interpretability in complex multi-step reasoning. To address these limitations, this paper proposes SGR, a stepwise reasoning enhancement framework that integrates large language models with external knowledge graphs through query-relevant subgraph generation. Given an input question, SGR first extracts key entities, relations, and constraints to construct a structured schema, then retrieves compact subgraphs from a knowledge graph using schema-guided querying. The generated subgraphs provide explicit relational evidence that guides the language model through step-by-step reasoning. In addition, SGR combines direct Cypher-based reasoning with collaborative reasoning integration, allowing candidate answers from multiple reasoning paths to be validated and aggregated according to both model confidence and graph consistency. Experiments on benchmark datasets including CWQ, WebQSP, GrailQA, and KQA Pro demonstrate that SGR improves reasoning accuracy and Hits@1 performance over standard prompting and several knowledge-enhanced baselines. Ablation studies further show that schema guidance and Neo4j-based retrieval are both crucial to the effectiveness of the framework. These results indicate that dynamically generated external subgraphs can improve the accuracy, robustness, and interpretability of LLM-based reasoning.

大模型推理知识图谱分步推理可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。