通过融合时空结构与事件链,提升时序知识图谱未来事件预测能力。
STK-Adapter: Incorporating Evolving Graph and Event Chain for Temporal Knowledge Graph Extrapolation

- 设计多专家模块捕捉图结构与时间模式的时空特征。
- 在多个基准数据集上超越现有方法,跨数据集泛化能力强。
- 适合对时序推理、知识图谱补全感兴趣的开发者与研究者。
时序知识图谱(TKG)外推旨在基于历史事实预测未来事件。近期研究尝试将TKG的动态结构表征与文本事件链融入大语言模型(LLM)以增强预测能力,但仍面临两大挑战:(1) 图结构表征与LLM语义空间浅层对齐导致关键时空信息丢失;(2) 在LLM微调过程中,图结构特征逐步稀释。为此,我们提出空间-时序知识适配器(STK-Adapter),灵活整合演化图编码器与LLM以支持TKG推理。STK-Adapter包含:空间-时序混合专家(MoE)以捕捉图中固有的空间结构与时间模式;事件感知混合专家(MoE)建模事件链内的复杂时间语义依赖;跨模态对齐混合专家(MoE)通过TKG引导的注意力专家实现深层跨模态对齐。在多个基准数据集上的大量实验表明,STK-Adapter显著优于当前最优方法,并在跨数据集任务中展现出强泛化能力。代码已公开于 https://github.com/Zhaoshuyuan0246/STK-Adapter。
原文摘要 · Abstract (English)
Temporal Knowledge Graph (TKG) extrapolation aims to predict future events based on historical facts. Recent studies have attempted to enhance TKG extrapolation by integrating TKG's evolving structural representations and textual event chains into Large Language Models (LLMs). Yet, two main challenges limit these approaches: (1) The loss of essential spatial-temporal information due to shallow alignment between TKG's graph evolving structural representation and the LLM's semantic space, and (2) the progressive dilution of the TKG's evolving structural features during LLM fine-tuning. To address these challenges, we propose the Spatial-Temporal Knowledge Adapter (STK-Adapter), which flexibly integrates the evolving graph encoder and the LLM to facilitate TKG reasoning. In STK-Adapter, a Spatial-Temporal MoE is designed to capture spatial structures and temporal patterns inherent in TKGs. An Event-Aware MoE is employed to model intricate temporal semantics dependencies within event chains. In addition, a Cross-Modality Alignment MoE is proposed to facilitate deep cross-modality alignment by TKG-guided attention experts. Extensive experiments on benchmark datasets demonstrate that STK-Adapter significantly outperforms state-of-the-art methods and exhibits strong generalization capabilities in cross-dataset task. The code is available at https://github.com/Zhaoshuyuan0246/STK-Adapter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。