arXiv:2602.00596cs.LG2026-02AAAI被引 1

提出新注意力机制,让图神经网络更好区分节点与边的时序行为。

Kernelized Edge Attention: Addressing Semantic Attention Blurring in Temporal Graph Neural Networks

  • 用连续时间核函数分别建模边的瞬时交互和节点的缓慢演化
  • 在链接预测任务上相比DyGFormer提升18%,比TGN提升7%
  • 适合需要精准时序建模和可解释性的动态图应用

动态图神经网络旨在捕捉动态图中结构与交互的时间演化。尽管许多模型通过编码或架构设计引入时间信息,但通常对纠缠的节点与边表示计算注意力,无法体现二者不同的时序特性。节点嵌入因聚合长期结构上下文而缓慢变化,边特征则反映瞬时、带时间戳的交互(如消息、交易)。这种不匹配导致语义注意力模糊,使注意力权重难以区分缓慢漂移的节点状态与快速变化的信息密集边交互。结果模型难以捕捉精细时序依赖,且无法透明揭示时序相关性计算过程。本文提出KEAT(Kernelized Edge Attention for Temporal Graphs),一种新型注意力形式,通过一系列连续时间核函数(包括拉普拉斯核、RBF核及可学习MLP变体)调制边特征。KEAT保持节点与边角色独立,可无缝集成于Transformer式(如DyGFormer)与消息传递式(如TGN)架构。在链接预测任务上,相较于近期的DyGFormer提升18% MRR,比TGN提升7%,实现了更准确、可解释且具时序感知的消息传递。

原文摘要 · Abstract (English)

Temporal Graph Neural Networks (TGNNs) aim to capture the evolving structure and timing of interactions in dynamic graphs. Although many models incorporate time through encodings or architectural design, they often compute attention over entangled node and edge representations, failing to reflect their distinct temporal behaviors. Node embeddings evolve slowly as they aggregate long-term structural context, while edge features reflect transient, timestamped interactions (e.g. messages, trades, or transactions). This mismatch results in semantic attention blurring, where attention weights cannot distinguish between slowly drifting node states and rapidly changing, information-rich edge interactions. As a result, models struggle to capture fine-grained temporal dependencies and provide limited transparency into how temporal relevance is computed. This paper introduces KEAT (Kernelized Edge Attention for Temporal Graphs), a novel attention formulation that modulates edge features using a family of continuous-time kernels, including Laplacian, RBF, and learnable MLP variant. KEAT preserves the distinct roles of nodes and edges, and integrates seamlessly with both Transformer-style (e.g., DyGFormer) and message-passing (e.g., TGN) architectures. It achieves up to 18% MRR improvement over the recent DyGFormer and 7% over TGN on link prediction tasks, enabling more accurate, interpretable and temporally aware message passing in TGNNs.

图神经网络时序建模注意力机制动态图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。