通过强化证据路径重要性,提升大模型在知识图谱问答中的推理能力。
EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and Answering
- 构建三阶段框架,从知识图谱中提取并筛选关键推理路径。
- 在多个基准数据集上超越现有方法,显著降低幻觉现象。
- 适合需要高可靠性推理的智能问答系统开发者使用。
由于强大的推理能力,大语言模型(LLMs)在知识图谱问答(KGQA)任务中表现优异,能够基于自然语言问题从知识图谱(KGs)中找出答案。为缓解LLMs的幻觉和知识缺失问题,现有方法通常从知识图谱中检索与问题相关的信息以丰富输入上下文。然而,多数方法仅关注信息相关性,忽略了不同类型知识在推理中的重要性差异,导致性能受限。为此,本文将KGQA问题重新建模为图结构问题,提出一种名为证据路径增强推理模型(EPERM)的三阶段框架。第一阶段,使用微调后的LLM从原始知识图谱中检索与问题相关的子图;第二阶段,过滤出能忠实支持问题推理的证据路径,并评估其推理重要性;第三阶段,利用加权证据路径进行最终答案推理。由于充分考虑了知识图谱中不同结构信息对推理的重要性,EPERM显著提升了LLMs在KGQA任务中的推理能力。在多个基准数据集上的大量实验表明,EPERM在各类KGQA任务中均取得优异性能。
原文摘要 · Abstract (English)
Due to the remarkable reasoning ability, Large language models (LLMs) have demonstrated impressive performance in knowledge graph question answering (KGQA) tasks, which find answers to natural language questions over knowledge graphs (KGs). To alleviate the hallucinations and lack of knowledge issues of LLMs, existing methods often retrieve the question-related information from KGs to enrich the input context. However, most methods focus on retrieving the relevant information while ignoring the importance of different types of knowledge in reasoning, which degrades their performance. To this end, this paper reformulates the KGQA problem as a graphical model and proposes a three-stage framework named the Evidence Path Enhanced Reasoning Model (EPERM) for KGQA. In the first stage, EPERM uses the fine-tuned LLM to retrieve a subgraph related to the question from the original knowledge graph. In the second stage, EPERM filters out the evidence paths that faithfully support the reasoning of the questions, and score their importance in reasoning. Finally, EPERM uses the weighted evidence paths to reason the final answer. Since considering the importance of different structural information in KGs for reasoning, EPERM can improve the reasoning ability of LLMs in KGQA tasks. Extensive experiments on benchmark datasets demonstrate that EPERM achieves superior performances in KGQA tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。