用大模型结合类型与子图推理,提升未知实体的常识图谱补全效果。
Context-aware Inductive Knowledge Graph Completion with Latent Type Constraints and Subgraph Reasoning
- 基于大模型,分两步判断:先看候选实体是否符合隐含类型,再分析路径与邻近事实相关性。
- 在18个设置中16个超越当前最佳,平均MRR提升7.2%。
- 适合处理新实体、少样本场景,尤其依赖上下文推理的任务。
归纳式知识图谱补全(KGC)旨在预测包含未见过实体的缺失三元组。现有方法多依赖头尾实体间的直接推理路径作为证据,但其性能受路径存在性与质量制约,泛化能力受限。本文发现,知识图谱中的隐含类型约束与邻近事实同样对推断缺失三元组至关重要。为此,提出CATS——一种上下文感知的归纳式KGC框架。通过提示引导与监督微调,激活大语言模型的语义理解与推理能力,综合判断查询三元组是否存在。该框架包含两个模块:类型感知推理模块用于检验候选实体是否满足查询关系所需的隐含类型;子图推理模块则选取相关推理路径与邻近事实,并评估其与查询三元组的相关性。在三个主流数据集上的实验表明,CATS在18种设置中的16种(涵盖归纳、直推与小样本场景)显著优于现有最优方法,平均绝对MRR提升7.2%。
原文摘要 · Abstract (English)
Inductive knowledge graph completion (KGC) aims to predict missing triples with unseen entities. Recent works focus on modeling reasoning paths between the head and tail entity as direct supporting evidence. However, these methods depend heavily on the existence and quality of reasoning paths, which limits their general applicability in different scenarios. In addition, we observe that latent type constraints and neighboring facts inherent in KGs are also vital in inferring missing triples. To effectively utilize all useful information in KGs, we introduce CATS, a novel context-aware inductive KGC solution. With sufficient guidance from proper prompts and supervised fine-tuning, CATS activates the strong semantic understanding and reasoning capabilities of large language models to assess the existence of query triples, which consist of two modules. First, the type-aware reasoning module evaluates whether the candidate entity matches the latent entity type as required by the query relation. Then, the subgraph reasoning module selects relevant reasoning paths and neighboring facts, and evaluates their correlation to the query triple. Experiment results on three widely used datasets demonstrate that CATS significantly outperforms state-of-the-art methods in 16 out of 18 transductive, inductive, and few-shot settings with an average absolute MRR improvement of 7.2%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。