用分组注意力建模时序知识图谱的长期依赖与事件激发关系。
GAttNHP: Group Attention Neural Hawkes Process for Extrapolation Reasoning in Temporal Knowledge Graphs

- 通过自注意力编码历史事件,捕捉远距离激发效应。
- 分组软聚类使链间共享激发模式,避免全量计算。
- 采用分位数回归提升重尾分布下的预测稳定性,适合长尾事件。
时序知识图谱(TKG)记录事实随时间演变的过程,但未来事件预测仍面临三大挑战:(i) 长程时间依赖难以建模;(ii) 不同事件链之间存在相互激发或抑制,快照模型无法表达;(iii) 事件间隔呈重尾分布且统计稀疏,确定性时间预测不可靠。本文提出统一框架GAttNHP,包含三个匹配组件:首先,自注意力编码器将每个实体-关系链视为连续时间点过程,捕获远期历史的持续激发;其次,语义软分组模块将全局可学习的霍克斯先验转化为分析性交叉注意力掩码,使链通过潜在分组身份共享激发模式,而非进行全对计算;第三,采用非交叉分位数(NCQ)回归头替代均值预测,提供校准且单调有序的分位数估计,在重尾间隔分布下仍保持稳定。在六个基准TKG数据集上,GAttNHP在实体与时间预测上均优于现有最优基线,消融实验证明其最大提升来自现有模型最易失败的长尾事件链。
原文摘要 · Abstract (English)
Temporal Knowledge Graphs (TKGs) record how facts evolve over time, but forecasting future events on a TKG remains difficult for three reasons: (i) long-range temporal dependencies are hard to encode; (ii) events on different chains mutually excite or inhibit one another in ways that snapshot-level models cannot express; and (iii) inter-arrival times are heavy-tailed and statistically sparse, so deterministic time predictors are unreliable. We address these three issues with a single framework, the \textbf{Group Attention Neural Hawkes Process (GAttNHP)}, built around three matched components. First, a self-attention encoder casts each subject--relation chain as a continuous-time point process and captures the lingering excitation of distant history. Second, a semantic soft-grouping module turns globally learnable Hawkes priors into an analytical cross-attention mask, so chains share excitation patterns through their latent group memberships rather than through exhaustive pairwise computation. Third, a Non-Crossing Quantile (NCQ) regression head replaces mean-based time prediction, providing calibrated, monotonically ordered quantile estimates that remain stable under heavy-tailed inter-arrival distributions. On six benchmark TKG datasets, GAttNHP improves over state-of-the-art baselines on both entity prediction and time prediction, and ablations confirm that its largest gains arise on the long-tail event chains where existing models fail most severely.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。