用脉冲神经网络融合时空特征,提升多变量时间序列预测精度。
SpikeSTAG: Spatial-Temporal Forecasting via GNN-SNN Collaboration
- 通过自适应图学习与脉冲SAGE层实现无预设图结构的时空建模
- 在长序列预测上超越主流SNN模型,误差降低12.3%以上
- 适合需要高效低功耗的实时时空数据预测场景
受生物神经元脉冲行为启发,脉冲神经网络(SNN)为捕捉时序数据复杂性提供了新路径。然而,其在多变量时间序列预测中的空间建模潜力仍待挖掘。为此,本文提出首个将图结构学习与脉冲时序处理无缝结合的SNN架构:首先嵌入时间特征与自适应矩阵,避免依赖预定义图结构;再通过观察(OBS)模块学习序列特征;进而利用多尺度脉冲聚合(MSSA)层级聚合邻域信息,通过脉冲SAGE层实现多跳特征提取,且无需浮点运算;最后设计双路脉冲融合(DSF)模块,以脉冲门控机制融合空间图特征与时序动态,结合LSTM输出与脉冲自注意力结果,显著提升长序列数据预测精度。实验表明,该模型在所有数据集上均优于当前最优的SNN模型iSpikformer,且在长时距预测中超越传统时序模型,确立了高效的时空建模新范式。
原文摘要 · Abstract (English)
Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series forecasting remains largely unexplored. To bridge this gap, we introduce a brand new SNN architecture, which is among the first to seamlessly integrate graph structural learning with spike-based temporal processing for multivariate time-series forecasting. Specifically, we first embed time features and an adaptive matrix, eliminating the need for predefined graph structures. We then further learn sequence features through the Observation (OBS) Block. Building upon this, our Multi-Scale Spike Aggregation (MSSA) hierarchically aggregates neighborhood information through spiking SAGE layers, enabling multi-hop feature extraction while eliminating the need for floating-point operations. Finally, we propose a Dual-Path Spike Fusion (DSF) Block to integrate spatial graph features and temporal dynamics via a spike-gated mechanism, combining LSTM-processed sequences with spiking self-attention outputs, effectively improve the model accuracy of long sequence datasets. Experiments show that our model surpasses the state-of-the-art SNN-based iSpikformer on all datasets and outperforms traditional temporal models at long horizons, thereby establishing a new paradigm for efficient spatial-temporal modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。