arXiv:2503.06474cs.IRcs.AI2025-03ACL被引 4

提升LLM在冷门领域问答的准确率,通过多阶段图检索增强系统。

ROGRAG: A Robustly Optimized GraphRAG Framework

  • 采用双层+逻辑形式的多阶段检索,不增加计算成本
  • 在SeedBench上将模型得分从60.0%提升至75.0%
  • 适合需要高可靠知识检索的科研与工业应用

大型语言模型(LLMs)在训练语料中罕见的专精或新兴话题上表现不佳。基于图的检索增强生成(GraphRAG)通过将领域知识构建成图结构实现动态检索,但现有流程工程复杂,难以分离各组件影响;同时因预训练与评估数据集存在重叠,难以有效评估检索效果。本文提出ROGRAG——一个鲁棒优化的GraphRAG框架。设计多阶段检索机制,融合双层与逻辑形式检索方法,在不增加计算开销的前提下提升检索鲁棒性;引入多种结果验证方式,并采用增量式数据库构建策略进行系统优化。通过大量消融实验,严格评估各组件有效性。在SeedBench上的对比实验显示,Qwen2.5-7B-Instruct初始得分仅60.0%,经过ROGRAG优化后提升至75.0%,优于主流方法。领域特定数据集实验表明,双层检索增强模糊匹配能力,逻辑形式检索提升结构化推理性能,凸显多阶段检索的重要性。ROGRAG已开源,支持pip安装。

原文摘要 · Abstract (English)

Large language models (LLMs) commonly struggle with specialized or emerging topics which are rarely seen in the training corpus. Graph-based retrieval-augmented generation (GraphRAG) addresses this by structuring domain knowledge as a graph for dynamic retrieval. However, existing pipelines involve complex engineering workflows, making it difficult to isolate the impact of individual components. It is also challenging to evaluate the retrieval effectiveness due to the overlap between the pretraining and evaluation datasets. In this work, we introduce ROGRAG, a Robustly Optimized GraphRAG framework. Specifically, we propose a multi-stage retrieval mechanism that integrates dual-level with logic form retrieval methods to improve retrieval robustness without increasing computational cost. To further refine the system, we incorporate various result verification methods and adopt an incremental database construction approach. Through extensive ablation experiments, we rigorously assess the effectiveness of each component. Our implementation includes comparative experiments on SeedBench, where Qwen2.5-7B-Instruct initially underperformed. ROGRAG significantly improves the score from 60.0% to 75.0% and outperforms mainstream methods. Experiments on domain-specific datasets reveal that dual-level retrieval enhances fuzzy matching, while logic form retrieval improves structured reasoning, highlighting the importance of multi-stage retrieval.ROGRAG is released as an open-source resource and supports installation with pip.

图神经网络检索增强大模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。