arXiv:2510.10114cs.CL2025-10被引 44

用轻量级图结构提升大文档检索,解决传统方法噪声多、成本高的问题。

LinearRAG: Linear Graph Retrieval Augmented Generation on Large-scale Corpora

  • 构建无关系的分层图(Tri-Graph),仅靠实体抽取和语义链接,避免复杂关系建模
  • 在四个数据集上显著优于基线模型,检索精度提升明显且扩展性好
  • 适合需要高效、可靠知识检索的大规模文本应用,如智能问答系统

检索增强生成(RAG)广泛用于缓解大语言模型的幻觉问题,通过引入外部知识。然而,传统RAG在大规模非结构化语料中表现不佳,因信息碎片化。近期方法引入知识图谱以捕捉关系结构,支持复杂多跳推理,但现有基于图的RAG(GraphRAG)依赖不稳定且昂贵的关系抽取构建图谱,常生成含错或不一致关系的噪声图,降低检索质量。本文重新审视现有GraphRAG流程,提出LinearRAG(基于线性图的检索增强生成),一种高效框架,实现可靠图构建与精准段落检索。具体而言,LinearRAG使用仅需轻量实体抽取与语义链接的无关系分层图(称作Tri-Graph),避免不稳定的關係建模。该新范式图构建随语料规模线性增长,且不增加额外词元开销,提供经济可靠的原始段落索引。检索采用两阶段策略:(i) 通过局部语义桥接激活相关实体,(ii) 通过全局重要性聚合进行段落检索。在四个数据集上的大量实验表明,LinearRAG显著优于基线模型。代码与数据集已公开于 https://github.com/DEEP-PolyU/LinearRAG。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) is widely used to mitigate hallucinations of Large Language Models (LLMs) by leveraging external knowledge. While effective for simple queries, traditional RAG systems struggle with large-scale, unstructured corpora where information is fragmented. Recent advances incorporate knowledge graphs to capture relational structures, enabling more comprehensive retrieval for complex, multi-hop reasoning tasks. However, existing graph-based RAG (GraphRAG) methods rely on unstable and costly relation extraction for graph construction, often producing noisy graphs with incorrect or inconsistent relations that degrade retrieval quality. In this paper, we revisit the pipeline of existing GraphRAG systems and propose LinearRAG (Linear Graph-based Retrieval-Augmented Generation), an efficient framework that enables reliable graph construction and precise passage retrieval. Specifically, LinearRAG constructs a relation-free hierarchical graph, termed Tri-Graph, using only lightweight entity extraction and semantic linking, avoiding unstable relation modeling. This new paradigm of graph construction scales linearly with corpus size and incurs no extra token consumption, providing an economical and reliable indexing of the original passages. For retrieval, LinearRAG adopts a two-stage strategy: (i) relevant entity activation via local semantic bridging, followed by (ii) passage retrieval through global importance aggregation. Extensive experiments on four datasets demonstrate that LinearRAG significantly outperforms baseline models. Our code and datasets are available at https://github.com/DEEP-PolyU/LinearRAG.

知识图谱检索增强大模型信息检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。