arXiv:2410.07165cs.AIcs.LG2024-10ACL被引 4

通过校准知识图谱补全模型,提升复杂逻辑查询的准确率。

Complex Logical Query Answering by Calibrating Knowledge Graph Completion Models

  • 将KGC模型预测值映射到[0,1]区间,使真事实接近1,假事实接近0
  • 在三个基准数据集上显著提升复杂逻辑查询回答性能
  • 方法轻量高效,不损害原模型排名评估指标,适合部署

复杂逻辑查询回答(CLQA)是在不完整知识图谱上寻找复杂逻辑查询答案的挑战性任务。以往研究利用预训练的知识图谱补全(KGC)模型预测缺失事实来回答复杂逻辑查询,但这些模型通常采用排序评估指标,导致预测值缺乏校准。本文提出一种轻量高效的校准方法CKGC,使KGC模型适应于复杂逻辑查询回答。其核心思想是将模型预测值映射至[0,1]范围,确保真实事实的预测值接近1,虚假事实接近0。在三个基准数据集上的实验表明,该方法显著提升了CLQA任务性能,同时保持了KGC模型原有的排序评估指标。代码已开源。

原文摘要 · Abstract (English)

Complex logical query answering (CLQA) is a challenging task that involves finding answer entities for complex logical queries over incomplete knowledge graphs (KGs). Previous research has explored the use of pre-trained knowledge graph completion (KGC) models, which can predict the missing facts in KGs, to answer complex logical queries. However, KGC models are typically evaluated using ranking evaluation metrics, which may result in values of predictions of KGC models that are not well-calibrated. In this paper, we propose a method for calibrating KGC models, namely CKGC, which enables KGC models to adapt to answering complex logical queries. Notably, CKGC is lightweight and effective. The adaptation function is simple, allowing the model to quickly converge during the adaptation process. The core concept of CKGC is to map the values of predictions of KGC models to the range [0, 1], ensuring that values associated with true facts are close to 1, while values linked to false facts are close to 0. Through experiments on three benchmark datasets, we demonstrate that our proposed calibration method can significantly boost model performance in the CLQA task. Moreover, our approach can enhance the performance of CLQA while preserving the ranking evaluation metrics of KGC models. The code is available at https://github.com/changyi7231/CKGC.

知识图谱逻辑查询模型校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。