针对知识图谱动态更新,提出自适应嵌入维度的渐进式演化框架。
SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding
- 根据更新规模动态调整嵌入维度,分阶段扩展表示空间。
- 在7个基准上实现MRR提升1.38%、H@1提升1.25%、H@10提升1.6%。
- 适合处理大规模、多尺度演化的知识图谱,对系统设计有启发。
传统知识图谱嵌入方法主要面向静态图,而现实中的知识图谱持续演化,新增实体、关系和事实。为此,已有持续知识图谱嵌入(CKGE)方法尝试在保留已有知识的同时高效更新嵌入。然而,现有方法未充分考虑更新规模差异,且缺乏对整个演化过程的系统评估。本文提出SAGE——一种感知尺度的渐进式演化框架。SAGE首先依据更新规模确定嵌入维度,并相应扩展嵌入空间;进一步采用动态蒸馏机制,在保留旧知识与融合新事实间取得平衡。在七个基准数据集上的实验表明,SAGE持续优于现有基线,平均提升1.38%(MRR)、1.25%(H@1)、1.6%(H@10)。与固定维度方法对比,SAGE在每个快照上均表现最优,验证了自适应维度的重要性。代码已公开:https://github.com/lyfxjtu/Dynamic-Embedding。
原文摘要 · Abstract (English)
Traditional knowledge graph (KG) embedding methods aim to represent entities and relations in a low-dimensional space, primarily focusing on static graphs. However, real-world KGs are dynamically evolving with the constant addition of entities, relations and facts. To address such dynamic nature of KGs, several continual knowledge graph embedding (CKGE) methods have been developed to efficiently update KG embeddings to accommodate new facts while maintaining learned knowledge. As KGs grow at different rates and scales in real-world scenarios, existing CKGE methods often fail to consider the varying scales of updates and lack systematic evaluation throughout the entire update process. In this paper, we propose SAGE, a scale-aware gradual evolution framework for CKGE. Specifically, SAGE firstly determine the embedding dimensions based on the update scales and expand the embedding space accordingly. The Dynamic Distillation mechanism is further employed to balance the preservation of learned knowledge and the incorporation of new facts. We conduct extensive experiments on seven benchmarks, and the results show that SAGE consistently outperforms existing baselines, with a notable improvement of 1.38% in MRR, 1.25% in H@1 and 1.6% in H@10. Furthermore, experiments comparing SAGE with methods using fixed embedding dimensions show that SAGE achieves optimal performance on every snapshot, demonstrating the importance of adaptive embedding dimensions in CKGE. The codes of SAGE are publicly available at: https://github.com/lyfxjtu/Dynamic-Embedding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。