让知识图谱推理更可信,通过不确定性感知提升可靠性
Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspective
- 引入置信区间控制机制,实现多步推理的误差可量化
- 在保证95%覆盖率前提下,预测集大小平均缩小40%
- 适合对可靠性要求高的医疗、金融等高风险场景
近期,知识图谱(KG)与大语言模型(LLMs)结合用于缓解幻觉并增强推理能力,如基于KG的检索增强框架。然而,现有KG-LLM框架缺乏严格的不确定性估计,限制了其在高风险应用中的可靠部署。由于架构复杂且图谱与模型间交互耦合,直接集成不确定性量化面临挑战。为此,本文提出可信的KG-LLM框架UAG,通过置信预测方法为预测集合提供理论保障,并设计误差率控制模块以调控各组件的误差水平。大量实验表明,UAG可在任意预设覆盖率达标的前提下,平均将预测集/区间规模缩减40%相较于基线。
原文摘要 · Abstract (English)
Recently, Knowledge Graphs (KGs) have been successfully coupled with Large Language Models (LLMs) to mitigate their hallucinations and enhance their reasoning capability, such as in KG-based retrieval-augmented frameworks. However, current KG-LLM frameworks lack rigorous uncertainty estimation, limiting their reliable deployment in high-stakes applications. Directly incorporating uncertainty quantification into KG-LLM frameworks presents challenges due to their complex architectures and the intricate interactions between the knowledge graph and language model components. To address this gap, we propose a new trustworthy KG-LLM framework, Uncertainty Aware Knowledge-Graph Reasoning (UAG), which incorporates uncertainty quantification into the KG-LLM framework. We design an uncertainty-aware multi-step reasoning framework that leverages conformal prediction to provide a theoretical guarantee on the prediction set. To manage the error rate of the multi-step process, we additionally introduce an error rate control module to adjust the error rate within the individual components. Extensive experiments show that our proposed UAG can achieve any pre-defined coverage rate while reducing the prediction set/interval size by 40% on average over the baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。