将文本中的隐含知识构建成图结构,提升大模型的推理能力
Reasoning with Graphs: Structuring Implicit Knowledge to Enhance LLMs Reasoning
- 从文本中自动构建实体关系图,显式表达隐含关联
- 在逻辑推理和多跳问答任务上显著提升模型表现
- 适合需要深度推理的任务,如复杂问答与知识推导
大型语言模型在众多任务中表现出色,但在需要理解文本序列中不同信息间关系的推理任务中仍面临挑战,尤其在涉及多步推理的任务(如逻辑推理和多跳问答)中,理解实体间的隐含关系并利用上下文中的多跳连接至关重要。图作为基础数据结构,可显式表示实体间的成对关系,具备增强大模型推理能力的潜力。已有研究证明外部图结构能有效支持大模型。然而,在许多推理任务中并无预设图结构。能否将上下文中隐含的知识结构化为图以辅助推理?本文提出基于图的推理方法(RwG),首先从上下文构建显式图结构,再利用该图提升大模型在推理任务中的性能。大量实验表明,该方法在逻辑推理和多跳问答任务中均有效提升了模型表现。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable success across a wide range of tasks; however, they still encounter challenges in reasoning tasks that require understanding and inferring relationships between distinct pieces of information within text sequences. This challenge is particularly pronounced in tasks involving multi-step processes, such as logical reasoning and multi-hop question answering, where understanding implicit relationships between entities and leveraging multi-hop connections in the given context are crucial. Graphs, as fundamental data structures, explicitly represent pairwise relationships between entities, thereby offering the potential to enhance LLMs' reasoning capabilities. External graphs have proven effective in supporting LLMs across multiple tasks. However, in many reasoning tasks, no pre-existing graph structure is provided. Can we structure implicit knowledge derived from context into graphs to assist LLMs in reasoning? In this paper, we propose Reasoning with Graphs (RwG) by first constructing explicit graphs from the context and then leveraging these graphs to enhance LLM reasoning performance on reasoning tasks. Extensive experiments demonstrate the effectiveness of the proposed method in improving both logical reasoning and multi-hop question answering tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。