arXiv:2505.19408cs.LG2025-05NeurIPS被引 4

不靠记忆模块,用注意力机制预测未来链接

Future Link Prediction Without Memory or Aggregation

  • 用可学习节点嵌入和跨注意力匹配源目标节点
  • 在多个数据集上表现优于现有方法,速度更快
  • 适合大规模动态图场景,尤其擅长发现新连接

时间图上的未来链接预测是真实动态系统中一项基础任务。这类场景通常包含重复出现(已见)和全新(未见)的交互,要求模型能有效泛化到两类边。然而,现有方法多依赖复杂的记忆与聚合模块,却难以处理未见边。本文重新审视现有时间图模型架构,识别出两个被忽视的关键建模需求:使用唯一标识符表示节点,并对源节点与目标节点进行目标感知匹配。为此,我们提出CRAFT(基于交叉注意力的时间图未来链接预测器),一种摒弃记忆与聚合模块的简洁高效架构,核心由可学习节点嵌入和目标节点与源节点近期交互之间的跨注意力构成。该设计具备强表达能力,可实现候选目标与源节点交互模式间的靶向兼容性建模。在多个数据集上的大量实验表明,CRAFT始终取得更优性能且效率高,适用于大规模真实应用。

原文摘要 · Abstract (English)

Future link prediction on temporal graphs is a fundamental task with wide applicability in real-world dynamic systems. These scenarios often involve both recurring (seen) and novel (unseen) interactions, requiring models to generalize effectively across both types of edges. However, existing methods typically rely on complex memory and aggregation modules, yet struggle to handle unseen edges. In this paper, we revisit the architecture of existing temporal graph models and identify two essential but overlooked modeling requirements for future link prediction: representing nodes with unique identifiers and performing target-aware matching between source and destination nodes. To this end, we propose Cross-Attention based Future Link Predictor on Temporal Graphs (CRAFT), a simple yet effective architecture that discards memory and aggregation modules and instead builds on two components: learnable node embeddings and cross-attention between the destination and the source's recent interactions. This design provides strong expressive power and enables target-aware modeling of the compatibility between candidate destinations and the source's interaction patterns. Extensive experiments on diverse datasets demonstrate that CRAFT consistently achieves superior performance with high efficiency, making it well-suited for large-scale real-world applications.

时间图链接预测注意力机制无记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。