不依赖大模型的轻量语义图检索框架,提升效率与鲁棒性
LiteSemRAG: Lightweight LLM-Free Semantic-Aware Graph Retrieval for Robust RAG

- 用词级别嵌入构建异构语义图,分离表面词汇与上下文语义
- 动态节点构造应对多义性,查询时分两步实现语义覆盖与结构推理
- 零大模型调用,索引与查询效率显著提升,适合高吞吐场景
基于图的检索增强生成(RAG)在多层级推理和结构化证据聚合方面展现出巨大潜力。然而,现有图式RAG框架在索引和查询阶段高度依赖大语言模型(LLM),导致高令牌消耗、计算开销和延迟。本文提出LiteSemRAG,一种完全无大模型、轻量级且具备语义感知能力的图检索框架。LiteSemRAG通过上下文词级别嵌入构建异构语义图,显式分离表面词汇表示与上下文依赖的语义含义。为鲁棒建模多义性,引入基于块级上下文聚合与自适应异常处理的动态语义节点构建机制。查询阶段,采用两步语义感知检索流程,融合共现图加权与孤立语义恢复机制,实现结构推理与语义覆盖的平衡。在三个基准数据集上的实验表明,LiteSemRAG在所有数据集上均取得最优平均倒数排名(MRR@10),召回率(Recall@10)达或优于当前最先进大模型驱动的图RAG系统。同时,该框架全程零大模型令牌消耗,因摒弃大模型使用而在索引与查询阶段实现显著效率提升。结果证明,无需依赖大模型也能构建强大的语义感知图检索系统。
原文摘要 · Abstract (English)
Graph-based Retrieval-Augmented Generation (RAG) has shown great potential for improving multi-level reasoning and structured evidence aggregation. However, existing graph-based RAG frameworks heavily rely on exploiting large language models (LLMs) during indexing and querying, leading to high token consumption, computational cost and latency overhead. In this paper, we propose LiteSemRAG, a lightweight, fully LLM-free, semantic-aware graph retrieval framework. LiteSemRAG constructs a heterogeneous semantic graph by exploiting contextual token-level embeddings, explicitly separating surface lexical representations from context-dependent semantic meanings. To robustly model polysemy, we introduce a dynamic semantic node construction mechanism with chunk-level context aggregation and adaptive anomaly handling. At query stage, LiteSemRAG performs a two-step semantic-aware retrieval process that integrates co-occurrence graph weighting with an isolated semantic recovery mechanism, enabling balanced structural reasoning and semantic coverage. We evaluate LiteSemRAG on three benchmark datasets and experimental results show that LiteSemRAG achieves the best mean reciprocal rank (MRR@10) across all datasets and competitive or superior recall rate (Recall@10) compared to state-of-the-art LLM-based graph RAG systems. Meanwhile, LiteSemRAG consumes zero LLM tokens and achieves substantial efficiency improvements in both indexing and querying due to the elimination of LLM usage. These results demonstrate the effectiveness of LiteSemRAG, indicating that a strong semantic-aware graph retrieval framework can be achieved without relying on LLM-based approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。