arXiv:2506.00445cs.CL2025-06ACL被引 7

提出G2S框架,让大模型先学通用规律再结合具体场景,提升时序知识图谱预测能力。

G2S: A General-to-Specific Learning Framework for Temporal Knowledge Graph Forecasting with Large Language Models

  • 分两阶段学习:先忽略具体实体关系,学通用时间模式;再注入具体信息。
  • 在多个数据集上显著优于现有方法,尤其在少样本场景下提升明显。
  • 适合需要强泛化能力的时序知识推理任务,如跨领域事件预测。

时序知识图谱(TKG)预测旨在基于历史事实预测未来事实,近年研究引入大语言模型(LLMs)以增强模型泛化能力。然而,现有方法同时学习两类纠缠知识:(1) 通用模式,即跨不同场景共享的时间结构;(2) 场景信息,即特定场景下的实体与关系。两者学习过程相互干扰,可能影响泛化性能。为此,本文提出通用到特定学习框架(G2S),解耦两类知识的学习过程。在通用学习阶段,通过掩码不同TKG中的场景信息,将其转换为匿名时间结构,使模型学习跨图通用模式;在特定学习阶段,通过上下文学习或微调方式注入场景信息。实验表明,G2S有效提升了LLMs在时序知识图谱预测中的泛化能力。

原文摘要 · Abstract (English)

Forecasting over Temporal Knowledge Graphs (TKGs) which predicts future facts based on historical ones has received much attention. Recent studies have introduced Large Language Models (LLMs) for this task to enhance the models' generalization abilities. However, these models perform forecasting via simultaneously learning two kinds of entangled knowledge in the TKG: (1) general patterns, i.e., invariant temporal structures shared across different scenarios; and (2) scenario information, i.e., factual knowledge engaged in specific scenario, such as entities and relations. As a result, the learning processes of these two kinds of knowledge may interfere with each other, which potentially impact the generalization abilities of the models. To enhance the generalization ability of LLMs on this task, in this paper, we propose a General-to-Specific learning framework (G2S) that disentangles the learning processes of the above two kinds of knowledge. In the general learning stage, we mask the scenario information in different TKGs and convert it into anonymous temporal structures. After training on these structures, the model is able to capture the general patterns across different TKGs. In the specific learning stage, we inject the scenario information into the structures via either in-context learning or fine-tuning modes. Experimental results show that G2S effectively improves the generalization abilities of LLMs.

时序知识图谱大模型泛化能力学习框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。