arXiv:2602.01124cs.LG2026-02被引 1

ChronoSpike用脉冲网络高效建模动态图,兼顾时序与结构,训练快3-10倍。

ChronoSpike: An Adaptive Spiking Graph Neural Network for Dynamic Graphs

  • 结合可学习脉冲神经元与注意力机制,实现局部精细建模与长程依赖捕捉。
  • 在三大基准上平均提升2.4% Micro-F1,训练速度比循环方法快3-10倍。
  • 适合需要高效处理动态图的场景,如社交网络、交通预测,且具备可解释性。

动态图表征学习需同时捕捉结构关系与时间演化,现有方法存在核心权衡:基于注意力的方法表达力强但复杂度高达$O(T^2)$,而循环架构易受梯度问题影响且状态存储密集。脉冲神经网络虽具事件驱动效率,却受限于串行传播、二值信息丢失及缺乏全局上下文的局部聚合。本文提出ChronoSpike,一种自适应脉冲图神经网络,融合可学习的莱夫金-伊夫神经元(LIF)、通道级膜电位动态、基于连续特征的多头空间注意力聚合,以及轻量级Transformer时序编码器。该设计实现细粒度局部建模与长程依赖捕获,激活/状态内存为$O(T \cdot d)$,每节点注意力项额外增加$O(T^2)$但评估范围内仍较小。ChronoSpike在三个大规模基准上优于十二个前沿基线,平均提升2.0%宏观F1与2.4%微观F1,训练速度比循环方法快3-10倍,参数量恒定为105K,不随图大小变化。理论分析证明膜电位有界性、收缩因子$ρ<1$下的梯度流稳定性及BIBO稳定性;可解释性分析揭示异质时序感受野与83-88%稀疏性的学习优先效应。

原文摘要 · Abstract (English)

Dynamic graph representation learning requires capturing both structural relations and temporal evolution, yet existing approaches face a core trade-off: attention-based methods offer expressiveness at $O(T^2)$ complexity, while recurrent architectures suffer from gradient pathologies and dense state storage. Spiking neural networks provide event-driven efficiency but are constrained by sequential propagation, binary information loss, and local aggregation that lacks global context. We propose ChronoSpike, an adaptive spiking graph neural network that integrates learnable LIF neurons with per-channel membrane dynamics, multi-head spatially-attentive aggregation over continuous features, and a lightweight Transformer temporal encoder. This design enables fine-grained local modeling and long-range dependency capture with $O(T \cdot d)$ activation/state memory and an additional $O(T^2)$ per-node attention term that remains small for the horizons evaluated here. ChronoSpike outperforms twelve state-of-the-art baselines on three large benchmarks by $2.0$% Macro-F1 and $2.4$% Micro-F1 on average while achieving $3-10\times$ faster training than recurrent methods with a constant 105K-parameter budget independent of graph size. We provide theoretical guarantees for membrane potential boundedness, gradient flow stability under contraction factor $ρ<1$, and BIBO stability; interpretability analyses reveal heterogeneous temporal receptive fields and a learned primacy effect with $83-88$% sparsity.

动态图脉冲神经网络图神经网络时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。