用知识图谱增强问答,让大模型更会跨文档推理。
Optimizing open-domain question answering with graph-based retrieval augmented generation
- 将知识构建成图结构,提升语义检索深度。
- TREX融合图与向量检索,在4个数据集上表现更优。
- 适合需要多源信息融合的复杂问答场景。
本文在涵盖OLTP式(事实型)和OLAP式(主题型)查询的多种问题类型上,基准测试了多种基于图的检索增强生成(RAG)系统,以应对开放域问答的复杂需求。传统RAG方法在处理细粒度、多文档综合任务时表现不足。通过将知识组织为图结构,可提升上下文检索的语义深度,从而增强语言模型能力。我们探索了多种图基RAG方法,并提出TREX——一种新颖且成本效益高的方案,结合图与向量检索技术。在四个不同数据集上的基准测试表明,各RAG方法各有优势,TREX展现出对多种开放域问答任务的适应性,同时揭示了现有评估方法的局限。在真实世界的技术支持案例研究中,TREX能更高效地整合异构数据源,优于传统的向量基RAG。结果凸显了通过先进检索与编排能力增强大模型的潜力,推动可扩展的图基人工智能解决方案发展。
原文摘要 · Abstract (English)
In this work, we benchmark various graph-based retrieval-augmented generation (RAG) systems across a broad spectrum of query types, including OLTP-style (fact-based) and OLAP-style (thematic) queries, to address the complex demands of open-domain question answering (QA). Traditional RAG methods often fall short in handling nuanced, multi-document synthesis tasks. By structuring knowledge as graphs, we can facilitate the retrieval of context that captures greater semantic depth and enhances language model operations. We explore graph-based RAG methodologies and introduce TREX, a novel, cost-effective alternative that combines graph-based and vector-based retrieval techniques. Our benchmarking across four diverse datasets highlights the strengths of different RAG methodologies, demonstrates TREX's ability to handle multiple open-domain QA types, and reveals the limitations of current evaluation methods. In a real-world technical support case study, we demonstrate how TREX solutions can surpass conventional vector-based RAG in efficiently synthesizing data from heterogeneous sources. Our findings underscore the potential of augmenting large language models with advanced retrieval and orchestration capabilities, advancing scalable, graph-based AI solutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。