基于霍克斯过程的模型,同时捕捉时序知识图谱的社区结构与事件衰减规律。
Hawkes based Representation Learning for Reasoning over Scale-free Community-structured Temporal Knowledge Graphs
- 用社区划分增强同组实体表示相似性
- 引入霍克斯过程建模事件影响随时间衰减
- 条件解码缓解长尾分布带来的高频实体偏见
时序知识图谱(TKG)推理因在诸多实际任务中的价值而备受关注。其核心在于建模图谱的结构信息与演化模式。尽管已有大量研究,但真实网络的结构与演化特性未被充分考虑:现实中网络通常具有明显的社区结构和幂律分布(长尾分布)特征,且事件的影响随时间推移而衰减。本文提出一种新型的时序知识图谱推理模型——基于霍克斯过程的演化表示学习网络(HERLN),可同时学习真实网络的社区结构、幂律分布及时间衰减特性。首先,在输入的TKG中识别社区,使同一社区内的实体编码更相似;其次,设计基于霍克斯过程的关系图卷积网络,以应对事件影响衰减现象;最后,引入条件解码机制,缓解长尾分布导致的高频实体偏差问题。实验表明,HERLN显著优于现有最优模型。
原文摘要 · Abstract (English)
Temporal knowledge graph (TKG) reasoning has become a hot topic due to its great value in many practical tasks. The key to TKG reasoning is modeling the structural information and evolutional patterns of the TKGs. While great efforts have been devoted to TKG reasoning, the structural and evolutional characteristics of real-world networks have not been considered. In the aspect of structure, real-world networks usually exhibit clear community structure and scale-free (long-tailed distribution) properties. In the aspect of evolution, the impact of an event decays with the time elapsing. In this paper, we propose a novel TKG reasoning model called Hawkes process-based Evolutional Representation Learning Network (HERLN), which learns structural information and evolutional patterns of a TKG simultaneously, considering the characteristics of real-world networks: community structure, scale-free and temporal decaying. First, we find communities in the input TKG to make the encoding get more similar intra-community embeddings. Second, we design a Hawkes process-based relational graph convolutional network to cope with the event impact-decaying phenomenon. Third, we design a conditional decoding method to alleviate biases towards frequent entities caused by long-tailed distribution. Experimental results show that HERLN achieves significant improvements over the state-of-the-art models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。