arXiv:2508.03553cs.IRcs.CL2025-08中稿 · ICDE 2025 Research…被引 14

多源检索生成中用知识图谱减少幻觉,提升准确性。

MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generation

  • 用多源线图聚合逻辑关系,解决数据稀疏问题。
  • 分层置信度评估,识别并剔除不可靠信息节点。
  • 在四个领域和两个多跳问答数据集上表现更优。

检索增强生成(RAG)是缓解大语言模型幻觉的有前景方案。然而,多源检索虽信息更丰富,却可能加剧幻觉问题,主要体现在两方面:多源数据分布稀疏,难以捕捉逻辑关系;不同来源间存在固有不一致,导致信息冲突。为此,我们提出MultiRAG框架,通过知识引导方法缓解多源检索生成中的幻觉。其核心创新包括:(1) 知识构建模块,采用多源线图高效聚合跨源逻辑关系,有效应对数据稀疏问题;(2) 复杂检索模块,实现图级与节点级双层置信度计算,识别并剔除不可靠信息节点,降低源间不一致引发的幻觉。在四个多领域查询数据集及两个多跳问答数据集上的大量实验表明,MultiRAG显著提升了复杂多源场景下的知识检索可靠性与效率。

原文摘要 · Abstract (English)

Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces new challenges that can paradoxically exacerbate hallucination problems. These challenges manifest primarily in two aspects: the sparse distribution of multi-source data that hinders the capture of logical relationships and the inherent inconsistencies among different sources that lead to information conflicts. To address these challenges, we propose MultiRAG, a novel framework designed to mitigate hallucination in multi-source retrieval-augmented generation through knowledge-guided approaches. Our framework introduces two key innovations: (1) a knowledge construction module that employs multi-source line graphs to efficiently aggregate logical relationships across different knowledge sources, effectively addressing the sparse data distribution issue; and (2) a sophisticated retrieval module that implements a multi-level confidence calculation mechanism, performing both graph-level and node-level assessments to identify and eliminate unreliable information nodes, thereby reducing hallucinations caused by inter-source inconsistencies. Extensive experiments on four multi-domain query datasets and two multi-hop QA datasets demonstrate that MultiRAG significantly enhances the reliability and efficiency of knowledge retrieval in complex multi-source scenarios. \textcolor{blue}{Our code is available in https://github.com/wuwenlong123/MultiRAG.

RAG幻觉抑制多源检索知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。