KAG通过融合知识图谱与检索增强生成,提升专业领域问答准确性。
KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation

- 用知识图谱增强语言模型的逻辑推理能力
- 在2wiki和hotpotQA上F1提升33.5%以上
- 适合医疗、政务等专业领域知识服务
近期发展的检索增强生成(RAG)技术已能有效构建领域专用应用,但仍存在向量相似性与知识相关性不一致、对数值、时间关系、专家规则等知识逻辑不敏感等问题,制约了专业知识服务的效果。本文提出面向专业领域的知识增强生成框架KAG,旨在充分发挥知识图谱(KG)与向量检索的优势,通过五方面双向增强大语言模型(LLM)与知识图谱:(1) LLM友好的知识表示,(2) 知识图谱与原始文本块间的互索引,(3) 基于逻辑形式的混合推理引擎,(4) 语义推理对齐知识,(5) KAG模型能力增强。在多跳问答任务中,与现有RAG方法对比,KAG显著优于当前最优方法,在2wiki上相对提升19.6%,在hotpotQA上相对提升33.5%(F1分数)。已成功应用于蚂蚁集团的两项专业知识问答任务——电子政务问答与电子健康问答,显著提升专业性表现。
原文摘要 · Abstract (English)
The recently developed retrieval-augmented generation (RAG) technology has enabled the efficient construction of domain-specific applications. However, it also has limitations, including the gap between vector similarity and the relevance of knowledge reasoning, as well as insensitivity to knowledge logic, such as numerical values, temporal relations, expert rules, and others, which hinder the effectiveness of professional knowledge services. In this work, we introduce a professional domain knowledge service framework called Knowledge Augmented Generation (KAG). KAG is designed to address the aforementioned challenges with the motivation of making full use of the advantages of knowledge graph(KG) and vector retrieval, and to improve generation and reasoning performance by bidirectionally enhancing large language models (LLMs) and KGs through five key aspects: (1) LLM-friendly knowledge representation, (2) mutual-indexing between knowledge graphs and original chunks, (3) logical-form-guided hybrid reasoning engine, (4) knowledge alignment with semantic reasoning, and (5) model capability enhancement for KAG. We compared KAG with existing RAG methods in multihop question answering and found that it significantly outperforms state-of-theart methods, achieving a relative improvement of 19.6% on 2wiki and 33.5% on hotpotQA in terms of F1 score. We have successfully applied KAG to two professional knowledge Q&A tasks of Ant Group, including E-Government Q&A and E-Health Q&A, achieving significant improvement in professionalism compared to RAG methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。