arXiv:2601.03597cs.CLcs.AI2026-01被引 1

让大模型用图结构推理,提升问答一致性与准确性

From Chains to Graphs: Self-Structured Reasoning for General-Domain LLMs

  • 让大模型自主构建图结构推理路径,替代线性思考
  • 在五个评测集上推理一致性提升,比基础模型高17.74%
  • 适合需要严谨逻辑的开放域问答任务,如科研与复杂决策

大型语言模型在开放域问答中展现出强大的推理能力,但其推理过程通常为线性且常出现逻辑不一致。现实推理需并行整合多个前提与子问题。现有方法如思维链(CoT)以线性文本表达推理,虽表面连贯,却常导致结论矛盾。近期方法依赖外部提供的图结构,未探索大模型如何自主构建与使用图结构推理,尤其在开放域问答中。为此,本文首次探索通用领域问答中大模型的图结构推理。提出自构图推理(SGR)框架,使大模型在生成答案前显式构建结构化推理图。进一步构建了一个图结构推理数据集,将多个候选推理图融合为优化后的图结构用于训练。在五个跨通用与专业领域的问答基准上实验表明,SGR显著提升推理一致性,在5个基准上平均优于基线17.74%。经SGR微调的LLaMA-3.3-70B模型性能媲美GPT-4o,超越Claude-3.5-Haiku,验证了图结构推理的有效性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) show strong reasoning ability in open-domain question answering, yet their reasoning processes are typically linear and often logically inconsistent. In contrast, real-world reasoning requires integrating multiple premises and solving subproblems in parallel. Existing methods, such as Chain-of-Thought (CoT), express reasoning in a linear textual form, which may appear coherent but frequently leads to inconsistent conclusions. Recent approaches rely on externally provided graphs and do not explore how LLMs can construct and use their own graph-structured reasoning, particularly in open-domain QA. To fill this gap, we novelly explore graph-structured reasoning of LLMs in general-domain question answering. We propose Self-Graph Reasoning (SGR), a framework that enables LLMs to explicitly represent their reasoning process as a structured graph before producing the final answer. We further construct a graph-structured reasoning dataset that merges multiple candidate reasoning graphs into refined graph structures for model training. Experiments on five QA benchmarks across both general and specialized domains show that SGR consistently improves reasoning consistency and yields a 17.74% gain over the base model. The LLaMA-3.3-70B model fine-tuned with SGR performs comparably to GPT-4o and surpasses Claude-3.5-Haiku, demonstrating the effectiveness of graph-structured reasoning.

图推理大模型问答系统逻辑一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。