用属性社区分层索引,提升知识图谱问答的准确率与效率
ArchRAG: Attributed Community-based Hierarchical Retrieval-Augmented Generation
- 基于属性社区构建分层索引,精准定位相关知识
- 在多个数据集上准确率提升3.2%-5.1%,令牌消耗减少40%以上
- 适合需要高效精准知识检索的问答系统开发者
检索增强生成(RAG)在将外部知识融入大语言模型以解决问答任务方面表现优异。当前最先进的RAG方法常使用图数据作为外部知识源,因其能捕捉实体间的丰富语义信息和关联关系。然而,现有基于图的RAG方法难以准确识别图中相关信息,且在线检索过程消耗大量令牌。为解决这些问题,我们提出一种新型基于图的RAG方法——属性社区分层检索增强生成(ArchRAG),通过属性社区增强问题表示,并引入一种基于LLM的分层聚类方法。为从图中检索最相关的信息,我们构建了属性社区的新型分层索引结构,并开发了高效的在线检索方法。实验结果表明,ArchRAG在准确率和令牌开销方面均优于现有方法。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs) for solving question-answer (QA) tasks. The state-of-the-art RAG approaches often use the graph data as the external data since they capture the rich semantic information and link relationships between entities. However, existing graph-based RAG approaches cannot accurately identify the relevant information from the graph and also consume large numbers of tokens in the online retrieval process. To address these issues, we introduce a novel graph-based RAG approach, called Attributed Community-based Hierarchical RAG (ArchRAG), by augmenting the question using attributed communities, and also introducing a novel LLM-based hierarchical clustering method. To retrieve the most relevant information from the graph for the question, we build a novel hierarchical index structure for the attributed communities and develop an effective online retrieval method. Experimental results demonstrate that ArchRAG outperforms existing methods in both accuracy and token cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。