arXiv:2605.16117cs.CL2026-05

用外部子图增强大模型推理,提升逻辑准确性和事实可靠性

SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation

论文配图:SGR: A Stepwise Reasoning Framework for LLMs with External Subgraph Generation
图 1 · 摘自论文原文
  • 基于问题构建外部知识子图,引导分步推理
  • 在多个基准上显著优于现有基线模型
  • 适合需要高可靠推理的问答系统

大型语言模型(LLMs)在翻译、文本生成和问答等自然语言任务中表现出色,但在需要深度推理和逻辑推断的复杂场景中仍存在局限。由于训练数据来自大规模文本语料库,其生成过程可能引入无关、噪声或事实不一致的内容。为此,我们提出SGR框架,通过外部子图生成来增强大模型的推理能力。SGR从外部知识库构建与查询相关的子图,并利用其语义结构支持多步推理。通过将中间推理步骤锚定在结构化外部知识上,该框架帮助模型聚焦于相关实体、关系和支撑证据。具体而言,SGR首先为输入问题构建定制化子图,然后引导模型逐步推理,并融合多种推理路径以获得最终预测。在多个基准数据集上的实验结果表明,SGR持续优于竞争性基线,验证了其在提升推理准确性和事实可靠性方面的价值。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong capabilities across diverse NLP applications, such as translation, text generation, and question answering. Nevertheless, they remain limited in complex settings that demand deep reasoning and logical inference. Since these models are trained on large-scale text corpora, their generation process may still introduce irrelevant, noisy, or factually inconsistent content. To mitigate this problem, we introduce SGR, a stepwise framework that enhances LLM reasoning through external subgraph generation. SGR builds query-specific subgraphs from external knowledge bases and uses their semantic structure to support multi-step inference. By grounding intermediate reasoning steps in structured external knowledge, the framework helps the model concentrate on relevant entities, relations, and supporting evidence. In particular, SGR first constructs a subgraph tailored to the input question. It then guides the model to reason progressively over the generated structure and combines multiple reasoning trajectories to obtain the final prediction. Experimental results across several benchmark datasets show that SGR achieves consistent improvements over competitive baselines, highlighting its value for improving both reasoning accuracy and factual reliability.

大模型推理知识增强子图生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。