arXiv:2507.16826cs.IRcs.AI2025-07被引 4

用知识图谱多路径融合提升大模型问答准确率

A Query-Aware Multi-Path Knowledge Graph Fusion Approach for Enhancing Retrieval-Augmented Generation in Large Language Models

  • 基于查询感知的多路径知识图谱构建,挖掘文档间深层关联
  • 在HotpotQA上达64.98% ROUGE-1,比基线高9.72个百分点
  • 适合需要精准推理和事实一致性的问答系统开发者

检索增强生成(RAG)已成为提升大语言模型生成内容准确性与事实一致性的有效范式。然而,现有研究多依赖相似度匹配检索孤立片段,忽视其内在关联,限制了性能。为此,我们提出查询感知多路径知识图谱融合方法(QMKGF)。首先设计提示模板,利用通用大模型高效提取实体与关系,构建知识图谱。基于该图谱,采用包含一跳、多跳及重要性关系的多路径子图构建策略,增强检索文档与用户查询的语义相关性。随后设计查询感知注意力奖励模型,对子图三元组按与查询的相关性打分,选取最高分子图,并融合其他高度相关的三元组进行扩充。最终将更新后的子图中实体、关系与三元组用于扩展原始查询,增强语义表示,提升大模型生成质量。在SQuAD、IIRC、Culture、HotpotQA和MuSiQue数据集上评估,结果表明,在HotpotQA上达到64.98%的ROUGE-1,相较BGE-Rerank提升9.72个百分点(55.26%→64.98%),验证了方法的有效性与优越性。

原文摘要 · Abstract (English)

Retrieval Augmented Generation (RAG) has gradually emerged as a promising paradigm for enhancing the accuracy and factual consistency of content generated by large language models (LLMs). However, existing RAG studies primarily focus on retrieving isolated segments using similarity-based matching methods, while overlooking the intrinsic connections between them. This limitation hampers performance in RAG tasks. To address this, we propose QMKGF, a Query-Aware Multi-Path Knowledge Graph Fusion Approach for Enhancing Retrieval Augmented Generation. First, we design prompt templates and employ general-purpose LLMs to extract entities and relations, thereby generating a knowledge graph (KG) efficiently. Based on the constructed KG, we introduce a multi-path subgraph construction strategy that incorporates one-hop relations, multi-hop relations, and importance-based relations, aiming to improve the semantic relevance between the retrieved documents and the user query. Subsequently, we designed a query-aware attention reward model that scores subgraph triples based on their semantic relevance to the query. Then, we select the highest score subgraph and enrich subgraph with additional triples from other subgraphs that are highly semantically relevant to the query. Finally, the entities, relations, and triples within the updated subgraph are utilised to expand the original query, thereby enhancing its semantic representation and improving the quality of LLMs' generation. We evaluate QMKGF on the SQuAD, IIRC, Culture, HotpotQA, and MuSiQue datasets. On the HotpotQA dataset, our method achieves a ROUGE-1 score of 64.98\%, surpassing the BGE-Rerank approach by 9.72 percentage points (from 55.26\% to 64.98\%). Experimental results demonstrate the effectiveness and superiority of the QMKGF approach.

知识图谱RAG大模型问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。