首个全归纳时间知识图谱推理模型,实现零样本泛化。
Towards Foundation Model on Temporal Knowledge Graph Reasoning
- 用正弦位置编码捕捉精细时间模式,结合局部与全局上下文生成自适应表示。
- 在未见实体、关系和时间上实现强零样本性能,跨数据集泛化能力显著提升。
- 适合需要跨域迁移的时序知识推理场景,如新领域知识建模与预测。
时间知识图谱(TKG)以四元组形式存储带时间戳的事实(s, p, o, t)。现有时间知识图谱嵌入(TKGE)模型在归纳或半归纳设置下进行链接预测,即测试图中的实体、关系和时间信息在训练中已部分或完全可见。这种对训练中已见元素的依赖限制了模型在新领域上的迁移能力和真实场景下的泛化性。核心挑战在于难以学习可迁移的实体、关系和时间表示,而不会绑定到特定数据集的词汇表。为此,我们提出首个全归纳的时间知识图谱链接预测方法。模型采用正弦位置编码捕捉细粒度时间模式,并通过条件于局部与全局时间上下文的消息传递生成自适应的实体与关系表示。模型设计与时间粒度和时间跨度无关,有效缓解不同TKG间的时间差异,促进时间感知结构信息的迁移。作为预训练、可扩展且可迁移的模型,POSTRA在未见过的时间知识图谱上表现出强大的零样本性能,有效泛化至新实体、新关系和新时间。理论分析与实证结果表明,单一预训练模型可在多种归纳式时间推理场景中提升零样本性能,标志着迈向时间知识图谱基础模型的重要一步。
原文摘要 · Abstract (English)
Temporal Knowledge Graphs (TKGs) store temporal facts with quadruple formats (s, p, o, t). Existing Temporal Knowledge Graph Embedding (TKGE) models perform link prediction tasks in transductive or semi-inductive settings, which means the entities, relations, and temporal information in the test graph are fully or partially observed during training. Such reliance on seen elements during inference limits the models' ability to transfer to new domains and generalize to real-world scenarios. A central limitation is the difficulty in learning representations for entities, relations, and timestamps that are transferable and not tied to dataset-specific vocabularies. To overcome these limitations, we introduce the first fully-inductive approach to temporal knowledge graph link prediction. Our model employs sinusoidal positional encodings to capture fine-grained temporal patterns and generates adaptive entity and relation representations using message passing conditioned on both local and global temporal contexts. Our model design is agnostic to temporal granularity and time span, effectively addressing temporal discrepancies across TKGs and facilitating time-aware structural information transfer. As a pretrained, scalable, and transferable model, POSTRA demonstrates strong zero-shot performance on unseen temporal knowledge graphs, effectively generalizing to novel entities, relations, and timestamps. Extensive theoretical analysis and empirical results show that a single pretrained model can improve zero-shot performance on various inductive temporal reasoning scenarios, marking a significant step toward a foundation model for temporal KGs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。