arXiv:2412.16311cs.LGcs.AI2024-12ACL被引 45

提出混合检索生成框架,同时利用文本与关系数据提升问答准确率。

HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Bases

  • 构建检索器库与批评模块,自动优化答案生成路径
  • 在STaRK基准上命中率提升51%(相对)
  • 适合需要跨文本和关系信息的复杂问答场景

面对半结构化知识库(SKB),其中文本文档通过关系相互连接,如何有效检索相关信息以回答用户问题?检索增强生成(RAG)依赖文档辅助大模型问答,而图检索增强生成(GRAG)则使用结构化知识库作为信息源。然而,许多问题需同时结合文本与关系信息——称为“混合”问题,这使检索过程复杂化,亟需能融合两类信息的混合检索方法。本文通过实证分析揭示现有方法在混合问答(HQA)上的局限性,并提出HybGRAG框架,包含检索器库与批评模块,具备四大优势:(1) 自主优化,通过批评模块反馈持续改进输出;(2) 自适应处理需文本与关系信息的混合问题;(3) 可解释性强,提供直观的修正路径;(4) 高效,在多个基准上超越所有基线。在STaRK基准测试中,HybGRAG实现平均51%的命中率(Hit@1)相对提升。

原文摘要 · Abstract (English)

Given a semi-structured knowledge base (SKB), where text documents are interconnected by relations, how can we effectively retrieve relevant information to answer user questions? Retrieval-Augmented Generation (RAG) retrieves documents to assist large language models (LLMs) in question answering; while Graph RAG (GRAG) uses structured knowledge bases as its knowledge source. However, many questions require both textual and relational information from SKB - referred to as "hybrid" questions - which complicates the retrieval process and underscores the need for a hybrid retrieval method that leverages both information. In this paper, through our empirical analysis, we identify key insights that show why existing methods may struggle with hybrid question answering (HQA) over SKB. Based on these insights, we propose HybGRAG for HQA consisting of a retriever bank and a critic module, with the following advantages: (1) Agentic, it automatically refines the output by incorporating feedback from the critic module, (2) Adaptive, it solves hybrid questions requiring both textual and relational information with the retriever bank, (3) Interpretable, it justifies decision making with intuitive refinement path, and (4) Effective, it surpasses all baselines on HQA benchmarks. In experiments on the STaRK benchmark, HybGRAG achieves significant performance gains, with an average relative improvement in Hit@1 of 51%.

知识问答混合检索图神经网络大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。