提出新框架FormerGNN,解决超关系知识图谱嵌入中的信息丢失问题。
Understanding the Embedding Models on Hyper-relational Knowledge Graph
- 通过三种分解方法将超关系图转为普通图,验证经典嵌入模型表现
- 发现现有模型性能受限于拓扑破坏与信息压缩,难融合主三元组与限定符
- 提出FormerGNN框架,保留原始拓扑并增强长程依赖建模能力
近年来,超关系知识图谱(HKGs)被提出以更准确地表示带限定符的真实世界事实。研究者尝试通过设计额外的限定符处理模块来适配经典知识图谱嵌入(KGE)模型。然而,当前超关系KGE(HKGE)模型的优越性究竟源于基础KGE模型还是扩展模块仍不明确。本文采用三种分解方法将HKGs转换为传统知识图谱格式,并评估多个经典KGE模型在HKG上的表现。结果表明,部分经典模型性能可媲美现有HKGE模型。进一步分析发现,分解方法会改变原始HKG拓扑结构,无法完整保留信息;且当前HKGE模型或难以捕捉长程依赖,或因信息压缩而难以有效整合主三元组与限定符信息。为验证结论并指引未来方向,本文提出FormerGNN框架:其采用限定符集成器保持原始拓扑,基于GNN的图编码器捕获长程依赖,并改进主三元组与限定符信息融合方式以缓解压缩问题。实验显示,FormerGNN显著优于现有HKGE模型。
原文摘要 · Abstract (English)
Recently, Hyper-relational Knowledge Graphs (HKGs) have been proposed as an extension of traditional Knowledge Graphs (KGs) to better represent real-world facts with additional qualifiers. As a result, researchers have attempted to adapt classical Knowledge Graph Embedding (KGE) models for HKGs by designing extra qualifier processing modules. However, it remains unclear whether the superior performance of Hyper-relational KGE (HKGE) models arises from their base KGE model or the specially designed extension module. Hence, in this paper, we data-wise convert HKGs to KG format using three decomposition methods and then evaluate the performance of several classical KGE models on HKGs. Our results show that some KGE models achieve performance comparable to that of HKGE models. Upon further analysis, we find that the decomposition methods alter the original HKG topology and fail to fully preserve HKG information. Moreover, we observe that current HKGE models are either insufficient in capturing the graph's long-range dependency or struggle to integrate main-triple and qualifier information due to the information compression issue. To further justify our findings and offer a potential direction for future HKGE research, we propose the FormerGNN framework. This framework employs a qualifier integrator to preserve the original HKG topology, and a GNN-based graph encoder to capture the graph's long-range dependencies, followed by an improved approach for integrating main-triple and qualifier information to mitigate compression issues. Our experimental results demonstrate that FormerGNN outperforms existing HKGE models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。