用知识图谱与向量库构建领域专用问答系统,减少幻觉、无需微调。
Domain-Specific Retrieval-Augmented Generation Using Vector Stores, Knowledge Graphs, and Tensor Factorization
- 融合知识图谱与向量库实现领域信息检索增强生成
- 在恶意软件分析数据集上准确率显著提升,且可溯源
- 无需大模型生成知识,适合医疗、金融等专业领域
大型语言模型(LLMs)虽在通用自然语言任务中表现优异,但在领域特定、知识密集型任务中易出现幻觉、知识截止且缺乏来源追溯。微调模型以适配特定领域成本高昂。检索增强生成(RAG)通过引用预定义本体优化输出,使用知识图谱(KG)可提升问答准确率。本文提出SMART-SLIC框架,整合领域专用的KG与向量存储(VS),通过自然语言处理、数据挖掘和非负张量分解自动构建,避免依赖大模型生成知识。结合链式思维提示代理,该框架支持结构化(KG)与非结构化(VS)信息检索,实现可溯源、低幻觉、少微调的领域问答系统。我们在恶意软件分析与异常检测的科学文献语料上验证了其性能,展现出优越的领域适应性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are pre-trained on large-scale corpora and excel in numerous general natural language processing (NLP) tasks, such as question answering (QA). Despite their advanced language capabilities, when it comes to domain-specific and knowledge-intensive tasks, LLMs suffer from hallucinations, knowledge cut-offs, and lack of knowledge attributions. Additionally, fine tuning LLMs' intrinsic knowledge to highly specific domains is an expensive and time consuming process. The retrieval-augmented generation (RAG) process has recently emerged as a method capable of optimization of LLM responses, by referencing them to a predetermined ontology. It was shown that using a Knowledge Graph (KG) ontology for RAG improves the QA accuracy, by taking into account relevant sub-graphs that preserve the information in a structured manner. In this paper, we introduce SMART-SLIC, a highly domain-specific LLM framework, that integrates RAG with KG and a vector store (VS) that store factual domain specific information. Importantly, to avoid hallucinations in the KG, we build these highly domain-specific KGs and VSs without the use of LLMs, but via NLP, data mining, and nonnegative tensor factorization with automatic model selection. Pairing our RAG with a domain-specific: (i) KG (containing structured information), and (ii) VS (containing unstructured information) enables the development of domain-specific chat-bots that attribute the source of information, mitigate hallucinations, lessen the need for fine-tuning, and excel in highly domain-specific question answering tasks. We pair SMART-SLIC with chain-of-thought prompting agents. The framework is designed to be generalizable to adapt to any specific or specialized domain. In this paper, we demonstrate the question answering capabilities of our framework on a corpus of scientific publications on malware analysis and anomaly detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。