arXiv:2506.05690cs.CL2025-06被引 47

对比图结构与普通检索,找出图增强生成在哪些场景下更有效。

When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generation

  • 构建多难度任务的GraphRAG-Bench基准测试
  • 发现图结构仅在深层推理任务中显著优于传统检索
  • 为实际应用提供何时使用图结构的明确指南

图检索增强生成(GraphRAG)作为一种提升大语言模型外部知识能力的新范式,通过图结构建模概念间的层级关系,实现更连贯、高效的推理。然而,现有研究表明,许多真实任务中GraphRAG表现反而不如传统RAG。为此,本文提出GraphRAG-Bench,一个涵盖事实检索、复杂推理、上下文摘要和创意生成等多类任务的综合性基准,系统评估从图构建、知识检索到最终生成的完整流程。基于该基准,我们深入分析了GraphRAG在何种条件下优于传统RAG,并揭示其成功背后的原因,为实际应用提供可操作的指导。相关资源已开源至https://github.com/GraphRAG-Bench/GraphRAG-Benchmark。

原文摘要 · Abstract (English)

Graph retrieval-augmented generation (GraphRAG) has emerged as a powerful paradigm for enhancing large language models (LLMs) with external knowledge. It leverages graphs to model the hierarchical structure between specific concepts, enabling more coherent and effective knowledge retrieval for accurate reasoning.Despite its conceptual promise, recent studies report that GraphRAG frequently underperforms vanilla RAG on many real-world tasks. This raises a critical question: Is GraphRAG really effective, and in which scenarios do graph structures provide measurable benefits for RAG systems? To address this, we propose GraphRAG-Bench, a comprehensive benchmark designed to evaluate GraphRAG models onboth hierarchical knowledge retrieval and deep contextual reasoning. GraphRAG-Bench features a comprehensive dataset with tasks of increasing difficulty, coveringfact retrieval, complex reasoning, contextual summarization, and creative generation, and a systematic evaluation across the entire pipeline, from graph constructionand knowledge retrieval to final generation. Leveraging this novel benchmark, we systematically investigate the conditions when GraphRAG surpasses traditional RAG and the underlying reasons for its success, offering guidelines for its practical application. All related resources and analyses are collected for the community at https://github.com/GraphRAG-Bench/GraphRAG-Benchmark.

图检索RAGLLM评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。