arXiv:2512.23356cs.CL2025-12

通过外部子图逐步引导,提升大模型推理准确性。

A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation

  • 从外部知识库动态构建查询相关子图,指导分步推理。
  • 在多个基准数据集上优于强基线,显著提升推理准确率。
  • 适合需要复杂逻辑推理的任务,如知识问答与数学推理。

近年来,大语言模型在机器翻译、文本生成和问答等自然语言处理任务中表现强劲。然而,随着应用向更复杂的场景拓展,模型在需要深度推理和逻辑推断的任务中仍面临挑战。尤其在大规模文本语料上训练的模型,在生成过程中可能引入噪声或无关信息,导致错误预测或与事实不符的输出。为解决此问题,我们提出一种基于外部子图生成的分步推理增强框架SGR。该框架从外部知识库动态构建与查询相关的子图,并利用其语义结构引导推理过程。通过在结构化子图上进行分步推理,SGR有效降低了噪声信息的影响,提升了推理准确性。具体而言,框架首先生成与输入查询匹配的外部子图,随后引导模型基于子图开展多步推理,并最终融合多条推理路径得到答案。在多个基准数据集上的实验结果表明,SGR持续优于强基线,验证了其在增强大模型推理能力方面的有效性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have achieved strong performance across a wide range of natural language processing tasks in recent years, including machine translation, text generation, and question answering. As their applications extend to increasingly complex scenarios, however, LLMs continue to face challenges in tasks that require deep reasoning and logical inference. In particular, models trained on large scale textual corpora may incorporate noisy or irrelevant information during generation, which can lead to incorrect predictions or outputs that are inconsistent with factual knowledge. To address this limitation, we propose a stepwise reasoning enhancement framework for LLMs based on external subgraph generation, termed SGR. The proposed framework dynamically constructs query relevant subgraphs from external knowledge bases and leverages their semantic structure to guide the reasoning process. By performing reasoning in a step by step manner over structured subgraphs, SGR reduces the influence of noisy information and improves reasoning accuracy. Specifically, the framework first generates an external subgraph tailored to the input query, then guides the model to conduct multi step reasoning grounded in the subgraph, and finally integrates multiple reasoning paths to produce the final answer. Experimental results on multiple benchmark datasets demonstrate that SGR consistently outperforms strong baselines, indicating its effectiveness in enhancing the reasoning capabilities of LLMs.

推理增强知识图谱大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。