KET-RAG通过分层索引降低图RAG的构建成本,提升检索与生成质量。
KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAG
- 先用LLM提取关键文本构建知识图骨架,再建轻量关键词-文本二分图。
- 检索时双路径搜索:在骨架上局部搜索,在二分图上模拟推理,效果更优。
- 索引成本降超90%,生成质量提升32.4%,适合大规模文档场景。
Graph-RAG通过从文本片段构建知识图来提升大语言模型问答中的检索能力,尤其适用于生物医学、法律和政治科学等需多跳推理的领域。现有方法多基于文本相关性构建粗粒度的KNN图,无法捕捉文本内的实体关系,导致检索与生成质量不佳。近期方案利用大模型提取实体与关系,构建三元组知识图,但索引开销巨大。为在保证精度的同时降低开销,本文提出KET-RAG——一种多粒度索引框架。该框架首先识别少量关键文本片段,用大模型构建知识图骨架;随后对所有文本片段构建轻量级文本-关键词二分图,作为全图的替代。检索时,系统在骨架上采用本地搜索策略,并在二分图上模拟此过程以增强检索效果。我们在三个真实数据集上评估13种方案,结果表明,KET-RAG在索引成本、检索有效性和生成质量上均优于所有对比方法。其检索质量可媲美微软Graph-RAG,索引成本降低超过一个数量级;同时生成质量最高提升32.4%,索引成本下降约20%。
原文摘要 · Abstract (English)
Graph-RAG constructs a knowledge graph from text chunks to improve retrieval in Large Language Model (LLM)-based question answering. It is particularly useful in domains such as biomedicine, law, and political science, where retrieval often requires multi-hop reasoning over proprietary documents. Some existing Graph-RAG systems construct KNN graphs based on text chunk relevance, but this coarse-grained approach fails to capture entity relationships within texts, leading to sub-par retrieval and generation quality. To address this, recent solutions leverage LLMs to extract entities and relationships from text chunks, constructing triplet-based knowledge graphs. However, this approach incurs significant indexing costs, especially for large document collections. To ensure a good result accuracy while reducing the indexing cost, we propose KET-RAG, a multi-granular indexing framework. KET-RAG first identifies a small set of key text chunks and leverages an LLM to construct a knowledge graph skeleton. It then builds a text-keyword bipartite graph from all text chunks, serving as a lightweight alternative to a full knowledge graph. During retrieval, KET-RAG searches both structures: it follows the local search strategy of existing Graph-RAG systems on the skeleton while mimicking this search on the bipartite graph to improve retrieval quality. We evaluate 13 solutions on three real-world datasets, demonstrating that KET-RAG outperforms all competitors in indexing cost, retrieval effectiveness, and generation quality. Notably, it achieves comparable or superior retrieval quality to Microsoft's Graph-RAG while reducing indexing costs by over an order of magnitude. Additionally, it improves the generation quality by up to 32.4% while lowering indexing costs by around 20%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。