用自适应多方面检索增强,让大模型答知识图谱题更准不胡编。
Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentation
- 根据问题动态筛选知识图谱中实体、关系和子图,生成提示嵌入。
- 在WebQSP和CWQ上准确率提升1.9%,逻辑形式生成提升6.6%。
- 适合需要高精度推理的问答系统开发者或研究者使用。
大型语言模型虽能力强大,但在复杂知识推理任务中常出现幻觉和知识过时问题,导致输出错误。以往方法通过从大规模知识图谱中检索事实来辅助模型推理,但常引入噪声与无关信息,尤其在多方面上下文场景下,易误导模型注意力。本文提出自适应多方面检索增强框架Amar,可检索实体、关系及子图,并将其转化为提示嵌入。该框架包含两个核心组件:自对齐模块,通过统一实体、关系与子图间的共性特征减少噪声;相关性门控模块,利用软门控学习问题与多方面检索数据的相关性,决定哪些信息用于增强输出或直接过滤。在WebQSP与CWQ两个基准数据集上,Amar达到当前最优性能,准确率优于最佳基线1.9%,逻辑形式生成较直接使用检索文本作提示的方法提升6.6%。结果验证了Amar在提升大模型推理能力方面的有效性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) demonstrate remarkable capabilities, yet struggle with hallucination and outdated knowledge when tasked with complex knowledge reasoning, resulting in factually incorrect outputs. Previous studies have attempted to mitigate it by retrieving factual knowledge from large-scale knowledge graphs (KGs) to assist LLMs in logical reasoning and prediction of answers. However, this kind of approach often introduces noise and irrelevant data, especially in situations with extensive context from multiple knowledge aspects. In this way, LLM attention can be potentially mislead from question and relevant information. In our study, we introduce an Adaptive Multi-Aspect Retrieval-augmented over KGs (Amar) framework. This method retrieves knowledge including entities, relations, and subgraphs, and converts each piece of retrieved text into prompt embeddings. The Amar framework comprises two key sub-components: 1) a self-alignment module that aligns commonalities among entities, relations, and subgraphs to enhance retrieved text, thereby reducing noise interference; 2) a relevance gating module that employs a soft gate to learn the relevance score between question and multi-aspect retrieved data, to determine which information should be used to enhance LLMs' output, or even filtered altogether. Our method has achieved state-of-the-art performance on two common datasets, WebQSP and CWQ, showing a 1.9\% improvement in accuracy over its best competitor and a 6.6\% improvement in logical form generation over a method that directly uses retrieved text as context prompts. These results demonstrate the effectiveness of Amar in improving the reasoning of LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。