新神经元模型让脉冲网络更好预测时间序列。
TS-LIF: A Temporal Segment Spiking Neuron Network for Time Series Forecasting
- 分层结构分离低频与高频信息处理,提升动态捕捉能力。
- 在缺失数据下仍保持高精度,优于传统脉冲网络。
- 适合需要低功耗、生物启发的时序预测场景。
脉冲神经网络(SNN)为处理时空数据提供了有前景的生物启发式方法,尤其适用于时间序列预测。然而,传统如漏斗积分-放电(LIF)神经元难以捕捉长期依赖并有效处理多尺度时间动态。为此,我们提出时序分段漏斗积分-放电(TS-LIF)模型,采用新颖的双室结构:树突与胞体分别专注于提取不同频率成分,实现功能异质性,增强对高低频信息的处理能力。此外,引入直接胞体电流注入机制减少神经元内部信息损失,树突尖峰生成则提升多尺度信息提取效果。我们提供了TS-LIF模型的理论稳定性分析,并解释各组件如何贡献于不同的频率响应特性。实验表明,TS-LIF在时间序列预测任务中优于传统SNN,展现出更高准确率与鲁棒性,即使在数据缺失情况下亦表现良好。该模型推动了SNN在时序预测中的应用,提供了一种能捕捉复杂时间动态的生物启发方案,具有广泛实际部署潜力。源码见:https://github.com/kkking-kk/TS-LIF。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) offer a promising, biologically inspired approach for processing spatiotemporal data, particularly for time series forecasting. However, conventional neuron models like the Leaky Integrate-and-Fire (LIF) struggle to capture long-term dependencies and effectively process multi-scale temporal dynamics. To overcome these limitations, we introduce the Temporal Segment Leaky Integrate-and-Fire (TS-LIF) model, featuring a novel dual-compartment architecture. The dendritic and somatic compartments specialize in capturing distinct frequency components, providing functional heterogeneity that enhances the neuron's ability to process both low- and high-frequency information. Furthermore, the newly introduced direct somatic current injection reduces information loss during intra-neuronal transmission, while dendritic spike generation improves multi-scale information extraction. We provide a theoretical stability analysis of the TS-LIF model and explain how each compartment contributes to distinct frequency response characteristics. Experimental results show that TS-LIF outperforms traditional SNNs in time series forecasting, demonstrating better accuracy and robustness, even with missing data. TS-LIF advances the application of SNNs in time-series forecasting, providing a biologically inspired approach that captures complex temporal dynamics and offers potential for practical implementation in diverse forecasting scenarios. The source code is available at https://github.com/kkking-kk/TS-LIF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。