arXiv:2410.00876cs.LG2024-10AAAI被引 8

用注意力机制替代路径编码,更快更准地补全知识图谱

Replacing Paths with Connection-Biased Attention for Knowledge Graph Completion

  • 引入连接偏好注意力和实体角色嵌入,无需路径编码
  • 在标准测试集上表现优于无路径模型,且速度更快
  • 适合追求高效准确的知识图谱补全研究者

知识图谱补全旨在从已有事实中推断出新增事实。当前研究多在归纳设置下进行,即测试时出现训练中未见的实体;高性能模型通常结合路径编码与子图编码模块。本文同样聚焦归纳设置,但不使用显式路径编码,因其耗时且需大量超参数调优。本方法仅采用基于Transformer的子图编码模块,通过引入连接偏好注意力和实体角色嵌入,消除对路径编码模块的需求。在标准归纳式知识图谱补全基准数据集上的实验表明,所提出的连接偏好链接预测(CBLiP)模型性能优于不使用路径信息的模型;相较于使用路径信息的模型,其表现相当或更优,同时运行更快。此外,为验证连接偏好注意力与实体角色嵌入的有效性在归纳设置外也成立,我们还在归纳设置下的关系预测任务中对比了CBLiP的表现。

原文摘要 · Abstract (English)

Knowledge graph (KG) completion aims to identify additional facts that can be inferred from the existing facts in the KG. Recent developments in this field have explored this task in the inductive setting, where at test time one sees entities that were not present during training; the most performant models in the inductive setting have employed path encoding modules in addition to standard subgraph encoding modules. This work similarly focuses on KG completion in the inductive setting, without the explicit use of path encodings, which can be time-consuming and introduces several hyperparameters that require costly hyperparameter optimization. Our approach uses a Transformer-based subgraph encoding module only; we introduce connection-biased attention and entity role embeddings into the subgraph encoding module to eliminate the need for an expensive and time-consuming path encoding module. Evaluations on standard inductive KG completion benchmark datasets demonstrate that our \textbf{C}onnection-\textbf{B}iased \textbf{Li}nk \textbf{P}rediction (CBLiP) model has superior performance to models that do not use path information. Compared to models that utilize path information, CBLiP shows competitive or superior performance while being faster. Additionally, to show that the effectiveness of connection-biased attention and entity role embeddings also holds in the transductive setting, we compare CBLiP's performance on the relation prediction task in the transductive setting.

知识图谱注意力机制补全模型Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。