arXiv:2606.30093cs.CLcs.IR2026-06

用词共现图提升大模型多跳问答效率,省时省力还更准。

Efficient Retrieval-Augmented Generation via Token Co-occurrence Graphs

论文配图:Efficient Retrieval-Augmented Generation via Token Co-occurrence Graphs
图 1 · 摘自论文原文
  • 基于滑动窗口统计词共现,快速构建知识图谱
  • 多跳推理中检索准确率超越现有方法,延迟更低
  • 适合需要高效精准推理的智能问答场景

检索增强生成(RAG)通过引入外部知识缓解大语言模型的幻觉问题。然而,传统RAG在多跳推理任务中表现不佳。尽管近期基于图结构的RAG方法提升了关联段落的检索能力,但普遍依赖计算成本高且易出错的LLM抽取流程。为此,我们提出TIGRAG(Token-Induced GraphRAG),一种基于词共现知识图谱的高效图增强RAG框架。TIGRAG利用滑动窗口的词共现统计直接建模词之间的拓扑关系,实现可扩展的图结构构建。推理阶段,结合图式语义扩展与神经重排序,检索支持多跳推理的连贯证据。具体提出一种迭代实体驱动的检索策略,通过从先前检索结果中提取桥接实体逐步扩展查询。我们在三个主流多跳问答(QA)基准上评估了TIGRAG,实验结果表明,该框架在检索和下游问答任务中持续优于密集检索与图基RAG方法,同时显著降低索引时间、推理延迟与提示规模。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Large Language Models (LLMs) by grounding the generation process on external knowledge. However, standard RAG approaches struggle with multi-hop reasoning. While recent graph-based RAG methods improve the retrieval of interconnected chunks, they often rely on computationally expensive and error-prone LLM-based extraction pipelines. To address these issues, we propose TIGRAG (Token-Induced GraphRAG), an efficient graph-augmented RAG framework based on a token co-occurrence Knowledge Graph. TIGRAG directly models topological relationships between tokens using sliding-window co-occurrence statistics, thus enabling scalable graph construction. During inference, it combines graph-based semantic expansion and neural reranking to retrieve interconnected evidence for multi-hop reasoning. Specifically, it introduces an iterative entity-driven retrieval strategy that progressively expands the query using bridging entities extracted from previously retrieved contexts. We evaluated TIGRAG on three widely adopted multi-hop Question Answering (QA) benchmarks. Experimental results demonstrated that our framework consistently outperforms dense retrieval and graph-based RAG methods in both retrieval and downstream QA tasks, while substantially reducing indexing time, inference latency, and prompt footprint.

RAG多跳推理知识图谱高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。