融合多种数据源的智能检索生成框架,提升大模型回答准确性与上下文一致性。
HetaRAG: Hybrid Deep Retrieval-Augmented Generation across Heterogeneous Data Stores
- 统一向量库、知识图谱、全文索引和关系数据库的多模态检索
- 动态路由与融合策略,兼顾召回率、准确率与上下文完整性
- 适合需要高可靠性的企业级知识问答系统使用
检索增强生成(RAG)已成为缓解大语言模型(LLM)知识幻觉和过时问题的主流范式,同时保持数据安全。传统RAG系统仅支持文本检索,依赖单一存储后端(如向量数据库),存在固有局限:向量搜索捕捉语义相似性但丢失全局上下文;知识图谱擅长关系精确性却召回不足;全文索引快速精准但缺乏语义理解;关系型数据库(如MySQL)具备强事务保障但无语义能力。本文认为这些异构检索方式具有互补性,提出一种系统化融合方案,实现协同优化。我们设计HetaRAG,一个跨异构数据源的混合深度检索增强生成框架,将向量索引、知识图谱、全文引擎与结构化数据库统一到同一检索平面,通过动态路由与证据融合,最大化召回率、精度与上下文保真度。初步探索已构建原型管道,技术报告提供概览,部分代码已在GitHub公开(https://github.com/KnowledgeXLab/HetaRAG)。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) has become a dominant paradigm for mitigating knowledge hallucination and staleness in large language models (LLMs) while preserving data security. By retrieving relevant evidence from private, domain-specific corpora and injecting it into carefully engineered prompts, RAG delivers trustworthy responses without the prohibitive cost of fine-tuning. Traditional retrieval-augmented generation (RAG) systems are text-only and often rely on a single storage backend, most commonly a vector database. In practice, this monolithic design suffers from unavoidable trade-offs: vector search captures semantic similarity yet loses global context; knowledge graphs excel at relational precision but struggle with recall; full-text indexes are fast and exact yet semantically blind; and relational engines such as MySQL provide strong transactional guarantees but no semantic understanding. We argue that these heterogeneous retrieval paradigms are complementary, and propose a principled fusion scheme to orchestrate them synergistically, mitigating the weaknesses of any single modality. In this work we introduce HetaRAG, a hybrid, deep-retrieval augmented generation framework that orchestrates cross-modal evidence from heterogeneous data stores. We plan to design a system that unifies vector indices, knowledge graphs, full-text engines, and structured databases into a single retrieval plane, dynamically routing and fusing evidence to maximize recall, precision, and contextual fidelity. To achieve this design goal, we carried out preliminary explorations and constructed an initial RAG pipeline; this technical report provides a brief overview. The partial code is available at https://github.com/KnowledgeXLab/HetaRAG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。