arXiv:2511.10375cs.CL2025-11中稿 · AAAI被引 16

用知识图谱解决大模型生成中的事实冲突问题

TruthfulRAG: Resolving Factual-level Conflicts in Retrieval-Augmented Generation with Knowledge Graphs

  • 构建检索内容的知识图谱,精准识别事实矛盾
  • 通过熵值过滤定位冲突点,提升生成准确性
  • 适合需要高可信度问答与知识推理的场景

检索增强生成(RAG)通过融合外部知识与生成模型,显著提升大语言模型(LLM)的能力。随着外部知识库不断扩展,而模型内部知识逐渐过时,如何解决检索信息与模型内知识之间的事实冲突,成为影响生成内容准确性和可靠性的关键挑战。现有方法多在词元或语义层面处理冲突,难以全面理解事实性差异,尤其在知识密集型任务中表现不足。为此,我们提出TruthfulRAG,首个基于知识图谱(KG)解决RAG系统中事实级知识冲突的框架。该方法系统地从检索内容中提取三元组构建知识图谱,采用基于查询的图检索识别相关知识,并运用熵基过滤机制精准定位冲突元素,有效缓解事实不一致,使大模型生成更忠实、准确的内容。大量实验表明,TruthfulRAG优于现有方法,显著降低知识冲突,提升RAG系统的鲁棒性与可信度。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework for enhancing the capabilities of Large Language Models (LLMs) by integrating retrieval-based methods with generative models. As external knowledge repositories continue to expand and the parametric knowledge within models becomes outdated, a critical challenge for RAG systems is resolving conflicts between retrieved external information and LLMs' internal knowledge, which can significantly compromise the accuracy and reliability of generated content. However, existing approaches to conflict resolution typically operate at the token or semantic level, often leading to fragmented and partial understanding of factual discrepancies between LLMs' knowledge and context, particularly in knowledge-intensive tasks. To address this limitation, we propose TruthfulRAG, the first framework that leverages Knowledge Graphs (KGs) to resolve factual-level knowledge conflicts in RAG systems. Specifically, TruthfulRAG constructs KGs by systematically extracting triples from retrieved content, utilizes query-based graph retrieval to identify relevant knowledge, and employs entropy-based filtering mechanisms to precisely locate conflicting elements and mitigate factual inconsistencies, thereby enabling LLMs to generate faithful and accurate responses. Extensive experiments reveal that TruthfulRAG outperforms existing methods, effectively alleviating knowledge conflicts and improving the robustness and trustworthiness of RAG systems.

知识图谱RAG事实一致性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。