arXiv:2503.13514cs.CLcs.AI2025-03被引 13

用知识图谱和动态学习减少大模型幻觉,提升推理能力。

RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integration

  • 多智能体架构融合RAG与增量知识图谱,持续更新结构化知识。
  • 在医疗问答中幻觉率显著降低,答案完整性和推理准确率提升。
  • 适合需要实时知识更新的高可靠场景,如医疗、金融领域。

本文提出RAG-KG-IL,一种新型多智能体混合框架,通过整合检索增强生成(RAG)、知识图谱(KG)与增量学习(IL),提升大语言模型(LLM)的推理能力。尽管已有进展,大模型在结构化数据推理、动态知识演化处理及幻觉抑制方面仍面临挑战,尤其在关键任务领域。本框架采用多智能体设计,实现知识持续更新,集成结构化知识,并通过自主智能体增强可解释性与推理能力。RAG确保生成内容基于可验证信息,KG提供领域结构化知识以提升一致性与理解深度。增量学习支持知识库动态更新,无需全量重训练,显著降低计算开销并提高适应性。我们在真实医疗查询案例中评估该框架,对比GPT-4o与纯RAG基线。实验结果表明,该方法显著降低幻觉率,提升答案完整性和推理准确性。结果证明,结合RAG、KG与多智能体系统,可构建具备实时知识整合与复杂领域推理能力的智能系统。

原文摘要 · Abstract (English)

This paper presents RAG-KG-IL, a novel multi-agent hybrid framework designed to enhance the reasoning capabilities of Large Language Models (LLMs) by integrating Retrieval-Augmented Generation (RAG) and Knowledge Graphs (KGs) with an Incremental Learning (IL) approach. Despite recent advancements, LLMs still face significant challenges in reasoning with structured data, handling dynamic knowledge evolution, and mitigating hallucinations, particularly in mission-critical domains. Our proposed RAG-KG-IL framework addresses these limitations by employing a multi-agent architecture that enables continuous knowledge updates, integrates structured knowledge, and incorporates autonomous agents for enhanced explainability and reasoning. The framework utilizes RAG to ensure the generated responses are grounded in verifiable information, while KGs provide structured domain knowledge for improved consistency and depth of understanding. The Incremental Learning approach allows for dynamic updates to the knowledge base without full retraining, significantly reducing computational overhead and improving the model's adaptability. We evaluate the framework using real-world case studies involving health-related queries, comparing it to state-of-the-art models like GPT-4o and a RAG-only baseline. Experimental results demonstrate that our approach significantly reduces hallucination rates and improves answer completeness and reasoning accuracy. The results underscore the potential of combining RAG, KGs, and multi-agent systems to create intelligent, adaptable systems capable of real-time knowledge integration and reasoning in complex domains.

大模型推理知识图谱幻觉抑制多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。