arXiv:2605.19735cs.CLcs.AI2026-05被引 1

无需大模型提取实体,用向量聚类构建知识图谱提升多跳问答效果。

ContextRAG: Extraction-Free Hierarchical Graph Construction for Retrieval-Augmented Generation

  • 不依赖LLM提取,通过残差量化k-means与形式概念分析构建模糊概念图。
  • 索引仅需30次LLM调用和2.2万tokens,相较传统方法减少超99%开销。
  • 在多跳任务上达36.8% F1,检索到图谱节点的查询性能提升3.9个百分点。

基于图结构的检索增强生成系统可提升多跳问题的答案质量,但现有系统常依赖大语言模型在索引阶段提取实体、关系与摘要,导致令牌和时延成本随语料库规模增长。本文提出ContextRAG,一种无需基于LLM进行实体或关系提取的图结构RAG系统。该系统通过残差量化k-means与卢卡西维茨剩余逻辑的形式概念分析,从段落嵌入中推导出模糊概念图。桥接型和交集型上下文节点由软模糊连接与交运算生成,而非由LLM生成的图边。在130个任务的UltraDomain子集上,ContextRAG仅需30次LLM调用和22,073个令牌完成索引;相比之下,本地HiRAG复现测试在20个任务子集上已需870次调用和354万令牌,且在图构建阶段失败;线性外推至130任务意味着超过2300万令牌。ContextRAG总体获得33.6% F1,多跳任务达36.8% F1。激活分析显示,检索到至少一个格结构衍生节点的查询,其F1比未检索到的高3.9个百分点;此关联具诊断性而非因果性。

原文摘要 · Abstract (English)

Graph-structured retrieval-augmented generation (RAG) systems can improve answer quality on multi-hop questions, but many current systems rely on large language models (LLMs) to extract entities, relations, and summaries during indexing. These calls add token and wall-clock costs that grow with corpus size. We present ContextRAG, a graph RAG system whose graph topology is constructed without LLM-based entity or relation extraction. ContextRAG derives a fuzzy concept graph over chunk embeddings using residual-quantization k-means and Formal Concept Analysis with Lukasiewicz residuated logic. Bridge-like and meet-derived context nodes are induced by soft fuzzy join and meet operations, rather than by LLM-written graph edges. On a 130-task UltraDomain subset, ContextRAG builds its index with 30 LLM calls and 22,073 tokens. In contrast, a local HiRAG reproduction stress test required 870 indexing calls and 3.54M tokens on a 20-task subset before failing during graph construction; linear extrapolation to 130 tasks implies over 23M indexing tokens. ContextRAG obtains 33.6% F1 overall and 36.8% F1 on multi-hop tasks. An activation analysis shows that queries retrieving at least one lattice-derived node in the top five achieve +3.9 percentage points F1 over queries that do not; this association is diagnostic rather than causal.

知识图谱RAG无提取多跳问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。