arXiv:2505.17464cs.CL2025-05EMNLP被引 11

HydraRAG让大模型跨源推理更准更快,无需训练就能提升问答能力。

HydraRAG: Structured Cross-Source Enhanced Large Language Model Reasoning

  • 用智能体协同图文与知识图谱检索,支持多跳、多实体推理。
  • 在7个数据集上比最强基线平均高20.3%,小模型达GPT-4水平。
  • 适合需要高可信推理的场景,如医疗、金融问答系统。

检索增强生成(RAG)通过引入外部知识提升大语言模型(LLM)性能。现有混合RAG系统从知识图谱(KG)和文本文档中检索证据以支持推理,但仍面临多跳推理、多实体问题、多源验证及图结构利用效率低等挑战。为此,我们提出HydraRAG——一种无需训练的框架,统一融合图结构拓扑、文本语义与源可靠性,支持深度、可信的模型推理。HydraRAG通过智能体驱动的探索机制,结合结构化与非结构化检索,提升证据多样性与精准度;针对多源验证,采用三因子机制(源可信度评估、跨源互证、实体路径对齐),平衡主题相关性与跨模态一致性。借助图结构,HydraRAG实现异构信息融合,引导高效探索并早期剔除噪声。在七个基准数据集上的实验证明,HydraRAG在GPT-3.5-Turbo上整体达到当前最优表现,平均优于强基线ToG-2 20.3%,最高提升30.1%。此外,该框架使较小模型(如Llama-3.1-8B)推理性能媲美GPT-4-Turbo。代码已开源:https://stevetantan.github.io/HydraRAG/

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge. Current hybrid RAG system retrieves evidence from both knowledge graphs (KGs) and text documents to support LLM reasoning. However, it faces challenges like handling multi-hop reasoning, multi-entity questions, multi-source verification, and effective graph utilization. To address these limitations, we present HydraRAG, a training-free framework that unifies graph topology, document semantics, and source reliability to support deep, faithful reasoning in LLMs. HydraRAG handles multi-hop and multi-entity problems through agent-driven exploration that combines structured and unstructured retrieval, increasing both diversity and precision of evidence. To tackle multi-source verification, HydraRAG uses a tri-factor cross-source verification (source trustworthiness assessment, cross-source corroboration, and entity-path alignment), to balance topic relevance with cross-modal agreement. By leveraging graph structure, HydraRAG fuses heterogeneous sources, guides efficient exploration, and prunes noise early. Comprehensive experiments on seven benchmark datasets show that HydraRAG achieves overall state-of-the-art results on all benchmarks with GPT-3.5-Turbo, outperforming the strong hybrid baseline ToG-2 by an average of 20.3% and up to 30.1%. Furthermore, HydraRAG enables smaller models (e.g., Llama-3.1-8B) to achieve reasoning performance comparable to that of GPT-4-Turbo. The source code is available on https://stevetantan.github.io/HydraRAG/.

RAG知识图谱多源验证推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。