arXiv:2505.09017cs.LGcs.SI2025-05

用状态空间模型更新参数,同时捕捉动态图的局部与全局结构。

DyGSSM: Multi-view Dynamic Graph Embeddings with State Space Model Gradient Update

  • 分视图提取局部(GCN)和全局(GRU随机游走)特征
  • 跨注意力融合多视角特征,提升节点表示能力
  • 基于HiPPO的SSM实现带历史依赖的参数更新,适合长时序建模

现有动态图表示学习方法通常将图划分为离散快照,仅在每个快照中通过消息传递或随机游走捕捉节点的局部或全局结构。随后使用序列模型(如Transformer)建模节点嵌入的时间演化,并借助元学习更新模型参数。然而,这些方法存在两个缺陷:一是未能同时提取每个快照中的局部与全局信息;二是更新参数时未考虑当前快照的表现,导致缺乏时间依赖性管理。针对此问题,本文提出多视图动态图嵌入方法DyGSSM,结合图卷积网络(GCN)进行局部特征提取,使用带门控循环单元(GRU)的随机游走捕获全局特征,并通过交叉注意力机制融合二者。同时,引入基于HiPPO算法的状态空间模型(SSM)来建模参数更新中的长期依赖,使每一步的性能反馈影响后续更新。在五个公开数据集上的实验表明,该方法在20项评测任务中有17项优于现有基线与最先进(SOTA)方法。

原文摘要 · Abstract (English)

Most of the dynamic graph representation learning methods involve dividing a dynamic graph into discrete snapshots to capture the evolving behavior of nodes over time. Existing methods primarily capture only local or global structures of each node within a snapshot using message-passing and random walk-based methods. Then, they utilize sequence-based models (e.g., transformers) to encode the temporal evolution of node embeddings, and meta-learning techniques to update the model parameters. However, these approaches have two limitations. First, they neglect the extraction of global and local information simultaneously in each snapshot. Second, they fail to consider the model's performance in the current snapshot during parameter updates, resulting in a lack of temporal dependency management. Recently, HiPPO (High-order Polynomial Projection Operators) algorithm has gained attention for their ability to optimize and preserve sequence history in State Space Model (SSM). To address the aforementioned limitations in dynamic graph representation learning, we propose a novel method called Multi-view Dynamic Graph Embeddings with State Space Model Gradient Update (DyGSSM). Our approach combines Graph Convolution Networks (GCN) for local feature extraction and random walk with Gated Recurrent Unit (GRU) for global feature extraction in each snapshot. We then integrate the local and global features using a cross-attention mechanism. Additionally, we incorporate an SSM based on HiPPO algorithm to account for long-term dependencies when updating model parameters, ensuring that model performance in each snapshot informs subsequent updates. Experiments on five public datasets show that our method outperforms existing baseline and state-of-the-art (SOTA) methods in 17 out of 20 cases.

动态图状态空间模型多视图图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。