让大模型推理更清晰,通过结构化知识图谱提升多跳问答准确率
Structure-Augmented Reasoning Generation
- 从检索文本中提取关系三元组,构建可适配领域的知识图谱
- 在金融与医学数据集上,推理准确率显著超越现有基线方法
- 无需微调即可接入现有流程,结果可追溯、解释性强
大型语言模型在复杂推理方面取得显著进展。检索增强生成(RAG)通过动态引入外部证据,使模型能访问训练参数之外的信息。然而,标准RAG将检索到的文档视为独立的非结构化文本块,迫使模型隐式关联碎片化信息,这对多跳问题尤为不利——正确回答需整合分散于不同文档的信息。我们提出结构增强推理生成(SARG),一个后检索框架,通过从检索内容中显式构建推理结构来弥补这一缺陷。SARG分为三步:利用少样本提示从文档中提取关系三元组;构建领域自适应的知识图谱;进行多跳遍历以识别相关推理链。这些链及其对应文本块被整合进生成提示,明确引导模型推理过程。SARG无需定制检索器或领域微调,可作为模块化组件兼容所有现有RAG系统。在开放域问答及金融、医学等专用推理数据集上的大量实验表明,SARG在事实准确性和推理连贯性上均显著优于当前最优的扁平上下文RAG基线。此外,通过揭示生成过程中使用的具体遍历路径,SARG实现了完全可追溯且可解释的推理。
原文摘要 · Abstract (English)
Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved evidence, enabling access to information beyond the model's training parameters. However, while RAG addresses knowledge availability, standard pipelines treat retrieved documents as independent, unstructured text chunks, forcing models to implicitly connect information across fragmented context. This limitation becomes critical for multi-hop queries, where answering correctly requires synthesizing information scattered across different documents. We present Structure-Augmented Reasoning Generation (SARG), a post-retrieval framework that addresses this gap by materializing explicit reasoning structures from retrieved context. SARG operates in three stages: extracting relational triples from retrieved documents via few-shot prompting, organizing these triples into a domain-adaptive knowledge graph, and performing multi-hop traversal to identify relevant reasoning chains. These chains, along with their associated text chunks, are then integrated into the generation prompt to explicitly guide the model's reasoning process. Importantly, SARG doesn't require custom retrievers or domain-specific fine-tuning. Instead, it functions as a modular layer compatible with all existing RAG pipelines. Extensive experiments on open-domain QA benchmarks and specialized reasoning datasets in finance and medicine demonstrate that SARG significantly outperforms state-of-the-art flat-context RAG baselines in both factual accuracy and reasoning coherence. Furthermore, by surfacing the exact traversal paths used during generation, SARG provides fully traceable and interpretable inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。