提出动态稀疏嵌入模型,提升知识图谱补全精度与鲁棒性。
DSparsE: Dynamic Sparse Embedding for Knowledge Graph Completion
- 用动态层和关系感知层构建浅编码器,实现高效特征提取。
- 在FB15k-237等数据集上Hits@1达当前最优水平。
- 稀疏连接结构缓解过拟合,适合追求高精度的知识图谱任务。
知识图谱补全仍面临完整性不足的挑战。现有方法存在局限:ComDensE易过拟合且深度增加时性能下降;InteractE在特征交互与可解释性方面表现有限。为此,我们提出动态稀疏嵌入(DSparsE)模型。该模型通过由动态层与关系感知层组成的浅层编码器对实体-关系对进行嵌入,随后将两层输出拼接,经投影层与带残差结构的深层解码器处理。该设计确保网络鲁棒性并保持特征提取能力。此外,模型中以随机初始化的稀疏连接层替代传统稠密层,有效缓解过拟合。在FB15k-237、WN18RR和YAGO3-10数据集上的实验表明,所提方法在Hits@1指标上优于现有基线。消融实验证明,动态层与关系感知层联合使用效果最佳。
原文摘要 · Abstract (English)
Addressing the incompleteness problem in knowledge graph remains a significant challenge. Current knowledge graph completion methods have their limitations. For example, ComDensE is prone to overfitting and suffers from the degradation with the increase of network depth while InteractE has the limitations in feature interaction and interpretability. To this end, we propose a new method called dynamic sparse embedding (DSparsE) for knowledge graph completion. The proposed model embeds the input entity-relation pairs by a shallow encoder composed of a dynamic layer and a relation-aware layer. Subsequently, the concatenated output of the dynamic layer and relation-aware layer is passed through a projection layer and a deep decoder with residual connection structure. This model ensures the network robustness and maintains the capability of feature extraction. Furthermore, the conventional dense layers are replaced by randomly initialized sparse connection layers in the proposed method, which can mitigate the model overfitting. Finally, comprehensive experiments are conducted on the datasets of FB15k-237, WN18RR and YAGO3-10. It was demonstrated that the proposed method achieves the state-of-the-art performance in terms of Hits@1 compared to the existing baseline approaches. An ablation study is performed to examine the effects of the dynamic layer and relation-aware layer, where the combined model achieves the best performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。