arXiv:2501.06713cs.AI2025-01被引 36

用极简设计让小模型也能高效实现检索增强生成。

MiniRAG: Towards Extremely Simple Retrieval-Augmented Generation

  • 构建融合文本块与实体的异构图索引,降低对语义理解的要求。
  • 仅需25%存储空间,性能接近大模型,适合资源受限场景。
  • 专为设备端复杂查询设计,开源完整评估数据集和代码。

随着对高效轻量级检索增强生成(RAG)系统的需求增长,现有框架在部署小型语言模型(SLMs)时面临严峻挑战。由于SLMs语义理解与文本处理能力有限,导致性能显著下降,限制了其在资源受限环境中的应用。为此,我们提出MiniRAG,一种极致简化且高效的RAG系统。该系统引入两项关键技术:(1) 语义感知的异构图索引机制,将文本块与命名实体统一建模,减少对复杂语义理解的依赖;(2) 轻量级拓扑增强检索方法,利用图结构实现高效知识发现,无需高级语言能力。大量实验表明,即便使用SLMs,MiniRAG性能仍可媲美基于大模型的方法,同时仅需25%存储空间。此外,我们构建了一个综合性基准数据集,用于评估轻量级RAG系统在真实设备端复杂查询下的表现。完整代码与数据集已开源:https://github.com/HKUDS/MiniRAG。

原文摘要 · Abstract (English)

The growing demand for efficient and lightweight Retrieval-Augmented Generation (RAG) systems has highlighted significant challenges when deploying Small Language Models (SLMs) in existing RAG frameworks. Current approaches face severe performance degradation due to SLMs' limited semantic understanding and text processing capabilities, creating barriers for widespread adoption in resource-constrained scenarios. To address these fundamental limitations, we present MiniRAG, a novel RAG system designed for extreme simplicity and efficiency. MiniRAG introduces two key technical innovations: (1) a semantic-aware heterogeneous graph indexing mechanism that combines text chunks and named entities in a unified structure, reducing reliance on complex semantic understanding, and (2) a lightweight topology-enhanced retrieval approach that leverages graph structures for efficient knowledge discovery without requiring advanced language capabilities. Our extensive experiments demonstrate that MiniRAG achieves comparable performance to LLM-based methods even when using SLMs while requiring only 25\% of the storage space. Additionally, we contribute a comprehensive benchmark dataset for evaluating lightweight RAG systems under realistic on-device scenarios with complex queries. We fully open-source our implementation and datasets at: https://github.com/HKUDS/MiniRAG.

检索增强轻量模型图结构设备端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。