RAGU用两阶段图谱构建提升大模型知识检索,更准更省显存。
RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM

- 分两步提取并去重实体关系,再用聚类与摘要优化图谱结构
- 在医学数据集上证据召回率达0.84,优于现有方法最多12.5%
- 仅用70亿参数模型即达320亿模型效果,适合资源受限场景
图谱增强生成(GraphRAG)通过结构化知识提升大模型性能,但现有系统在单次抽取中易产生噪声实体和脆弱检索。RAGU是一个开源模块化引擎,将抽取与整合分离:实体与关系经过两阶段类型化抽取、基于DBSCAN的去重、大模型摘要及Leiden社区检测。关键洞察是:模型在任务中所需的理解、抽取与推理能力随规模增长缓慢,而事实知识则不然。因此训练了专注语言技能的70亿参数模型Meno-Lite-0.1,其在图谱构建任务上超越Qwen2.5-32B(相对调和均值提升12.5%),并在英文GraphRAG任务上表现相当。在GraphRAG-Bench(Medical)上,RAGU在每个事实层级均实现最高上下文召回率(最高0.84,对比≤0.76),且在合成任务上超越HippoRAG2;多跳问答中,看似优势实为答案格式偏差所致。RAGU可通过pip安装,单卡运行,开源协议为MIT。源码见https://github.com/RaguTeam/RAGU,模型可从https://huggingface.co/bond005/meno-lite-0.1获取。
原文摘要 · Abstract (English)
Graph retrieval-augmented generation (GraphRAG) enhances large language models with structured knowledge, yet existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU, an open-source modular GraphRAG engine, addresses this by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection. A key insight motivates a compact extractor: the skills an in-pipeline LLM needs - comprehension, extraction, reasoning over context - are language skills that grow only weakly with model size, unlike factual world knowledge. Accordingly, we train Meno-Lite-0.1, a 7B model optimized for language skills, which outperforms Qwen2.5-32B on knowledge-graph construction (+12.5% relative harmonic mean) and matches it on English GraphRAG tasks. On GraphRAG-Bench (Medical), RAGU retrieves the most complete context at every factoid level (evidence recall up to 0.84 vs. $\leq$0.76) and overtakes HippoRAG2 on synthesis tasks; on multi-hop factoid QA, the apparent HippoRAG2 advantage is shown to be largely an answer-format artifact. RAGU is installable via $\texttt{pip install graph_ragu}$, runs on a single GPU, and is released under MIT. The source code is publicly available at https://github.com/RaguTeam/RAGU, and the Meno-Lite-0.1 model can be obtained from https://huggingface.co/bond005/meno-lite-0.1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。