arXiv:2506.08158cs.CL2025-06被引 4

用可学习的高效标记实现知识图谱持续学习中的快速知识迁移。

ETT-CKGE: Efficient Task-driven Tokens for Continual Knowledge Graph Embedding

  • 引入可学习的任务驱动标记,替代繁琐的节点重要性计算。
  • 通过矩阵运算完成跨快照对齐,训练速度提升显著。
  • 适合需要高效持续学习的知识图谱应用开发者。

持续知识图谱嵌入(CKGE)旨在不断融入新知识的同时保留旧信息。现有方法因两大局限而效率低下:(1)快照间知识保留不佳,因手动设计的节点/关系重要性评分忽略下游任务相关的图依赖;(2)节点/关系重要性计算需昂贵的图遍历,导致训练慢、内存开销大。为此,我们提出ETT-CKGE(高效、任务驱动、用于持续知识图谱嵌入的标记),一种新型任务引导式CKGE方法。该方法引入一组可学习的标记,直接捕捉任务相关信号,无需显式节点评分或图遍历。这些标记在快照间提供一致且可复用的指导,实现高效的标记掩码嵌入对齐。知识迁移仅通过简单矩阵运算完成,大幅降低训练时间与内存消耗。在六个基准数据集上的实验表明,ETT-CKGE始终达到更优或相当的预测性能,同时显著优于现有最优方法,在训练效率和可扩展性上表现突出。代码已开源:https://github.com/lijingzhu1/ETT-CKGE/tree/main

原文摘要 · Abstract (English)

Continual Knowledge Graph Embedding (CKGE) seeks to integrate new knowledge while preserving past information. However, existing methods struggle with efficiency and scalability due to two key limitations: (1) suboptimal knowledge preservation between snapshots caused by manually designed node/relation importance scores that ignore graph dependencies relevant to the downstream task, and (2) computationally expensive graph traversal for node/relation importance calculation, leading to slow training and high memory overhead. To address these limitations, we introduce ETT-CKGE (Efficient, Task-driven, Tokens for Continual Knowledge Graph Embedding), a novel task-guided CKGE method that leverages efficient task-driven tokens for efficient and effective knowledge transfer between snapshots. Our method introduces a set of learnable tokens that directly capture task-relevant signals, eliminating the need for explicit node scoring or traversal. These tokens serve as consistent and reusable guidance across snapshots, enabling efficient token-masked embedding alignment between snapshots. Importantly, knowledge transfer is achieved through simple matrix operations, significantly reducing training time and memory usage. Extensive experiments across six benchmark datasets demonstrate that ETT-CKGE consistently achieves superior or competitive predictive performance, while substantially improving training efficiency and scalability compared to state-of-the-art CKGE methods. The code is available at: https://github.com/lijingzhu1/ETT-CKGE/tree/main

知识图谱持续学习嵌入模型高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。