用知识图谱替代传统检索,提升大模型问答准确率
TOBUGraph: Knowledge Graph-Based Retrieval for Enhanced LLM Performance Beyond RAG
- 构建动态知识图谱,通过关系抽取替代文本相似度匹配
- 在真实用户数据上,召回率和精确率均优于多种RAG方案
- 无需分块配置,减少幻觉,适合生产级记忆管理场景
检索增强生成(RAG)是提升大模型检索能力的主要技术,但在实际应用中仍存在显著局限:主要依赖嵌入空间中的查询-片段文本相似度进行检索,难以捕捉片段间的深层语义关系,对分块策略敏感,且易产生幻觉。为此,我们提出TOBUGraph,一种基于知识图谱的检索框架。该框架利用大模型从非结构化数据中动态、自动构建知识图谱,提取结构化知识与多样关系,突破RAG仅依赖文本相似度的限制。通过图遍历实现检索,利用已提取的关系与结构提升准确性,避免分块配置,并降低幻觉风险。我们在真实生产环境中的个人记忆组织与检索应用TOBU中验证了TOBUGraph的有效性。基于真实用户数据的评估表明,TOBUGraph在精确率和召回率上均优于多个RAG实现,显著提升了用户体验。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) is one of the leading and most widely used techniques for enhancing LLM retrieval capabilities, but it still faces significant limitations in commercial use cases. RAG primarily relies on the query-chunk text-to-text similarity in the embedding space for retrieval and can fail to capture deeper semantic relationships across chunks, is highly sensitive to chunking strategies, and is prone to hallucinations. To address these challenges, we propose TOBUGraph, a graph-based retrieval framework that first constructs the knowledge graph from unstructured data dynamically and automatically. Using LLMs, TOBUGraph extracts structured knowledge and diverse relationships among data, going beyond RAG's text-to-text similarity. Retrieval is achieved through graph traversal, leveraging the extracted relationships and structures to enhance retrieval accuracy, eliminating the need for chunking configurations while reducing hallucination. We demonstrate TOBUGraph's effectiveness in TOBU, a real-world application in production for personal memory organization and retrieval. Our evaluation using real user data demonstrates that TOBUGraph outperforms multiple RAG implementations in both precision and recall, significantly improving user experience through improved retrieval accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。