arXiv:2507.21110cs.CLcs.AI2025-07被引 6

SemRAG通过语义分块和知识图谱提升问答准确性,无需大量微调。

SemRAG: Semantic Knowledge-Augmented RAG for Improved Question-Answering

  • 用语义相似度分块文档,保持上下文连贯性
  • 构建知识图谱捕捉实体关系,提升检索准确率
  • 适配不同数据集的缓冲区优化,适合领域专用场景

本文提出SemRAG,一种增强型检索增强生成框架,通过语义分块与知识图谱高效融入领域知识,避免大规模微调。现有方法计算成本高、易过拟合且难以扩展。SemRAG采用基于句子嵌入余弦相似度的语义分块算法,保留语义一致性并降低计算开销;将检索信息结构化为知识图谱,捕捉实体间关系,提升检索精度与上下文理解能力。在MultiHop RAG和Wikipedia数据集上的实验表明,该方法显著提高知识图谱中检索信息的相关性与正确性,优于传统RAG方法。进一步研究发现,针对不同数据语料优化缓冲区大小可进一步提升性能。其核心优势在于无需资源密集型微调,即可构建高效、准确的领域专用大模型流程,具备良好可扩展性,符合可持续发展要求,适用于专业领域AI应用。

原文摘要 · Abstract (English)

This paper introduces SemRAG, an enhanced Retrieval Augmented Generation (RAG) framework that efficiently integrates domain-specific knowledge using semantic chunking and knowledge graphs without extensive fine-tuning. Integrating domain-specific knowledge into large language models (LLMs) is crucial for improving their performance in specialized tasks. Yet, existing adaptations are computationally expensive, prone to overfitting and limit scalability. To address these challenges, SemRAG employs a semantic chunking algorithm that segments documents based on the cosine similarity from sentence embeddings, preserving semantic coherence while reducing computational overhead. Additionally, by structuring retrieved information into knowledge graphs, SemRAG captures relationships between entities, improving retrieval accuracy and contextual understanding. Experimental results on MultiHop RAG and Wikipedia datasets demonstrate SemRAG has significantly enhances the relevance and correctness of retrieved information from the Knowledge Graph, outperforming traditional RAG methods. Furthermore, we investigate the optimization of buffer sizes for different data corpus, as optimizing buffer sizes tailored to specific datasets can further improve retrieval performance, as integration of knowledge graphs strengthens entity relationships for better contextual comprehension. The primary advantage of SemRAG is its ability to create an efficient, accurate domain-specific LLM pipeline while avoiding resource-intensive fine-tuning. This makes it a practical and scalable approach aligned with sustainability goals, offering a viable solution for AI applications in domain-specific fields.

RAG知识图谱语义分块大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。