用脉冲神经网络建模稀疏事件数据,提升物联网时序预测精度与效率。
SEDformer: Event-Synchronous Spiking Transformers for Irregular Telemetry Time Series Forecasting
- 基于脉冲编码将不规则时间序列转为事件同步脉冲信号。
- 在压缩长间隔时保留关键事件,降低计算开销30%以上。
- 适合高稀疏、突发性事件的物联网系统实时预测场景。
大规模互联网系统(如物联网部署和在线平台)产生的遥测流天然构成不规则多变量时间序列(IMTS),其准确预测对运维至关重要。分析发现IMTS具有显著的稀疏-事件二元性(SED):长时间段观测稀疏,短时段内集中爆发大量语义事件。现有图神经网络与Transformer方法忽视此特性:统一网格预对齐引入大量填充,虚增计算量;关系重构破坏局部时序连续性,弱化事件语义。为此,我们提出SEDformer——一种面向IMTS的脉冲变压器模型,包含:(1) 基于事件对齐的LIF神经元的脉冲编码器,将原始观测转化为事件同步脉冲;(2) 事件保持的时间下采样模块,在压缩长间隙的同时保留关键发放;(3) 脉冲驱动的膜电位线性注意力机制的脉冲变压器块,实现序列内依赖建模。在公开遥测数据集上的实验表明,SEDformer达到当前最优预测精度,同时降低能耗与内存使用,为不规则时序建模提供自然高效的路径。
原文摘要 · Abstract (English)
Telemetry streams from large-scale Internet-connected systems (e.g., IoT deployments and online platforms) naturally form an irregular multivariate time series (IMTS) whose accurate forecasting is operationally vital. A closer examination reveals a defining Sparsity-Event Duality (SED) property of IMTS, i.e., long stretches with sparse or no observations are punctuated by short, dense bursts where most semantic events (observations) occur. However, existing Graph- and Transformer-based forecasters ignore SED: pre-alignment to uniform grids with heavy padding violates sparsity by inflating sequences and forcing computation at non-informative steps, while relational recasting weakens event semantics by disrupting local temporal continuity. These limitations motivate a more faithful and natural modeling paradigm for IMTS that aligns with its SED property. We find that Spiking Neural Networks meet this requirement, as they communicate via sparse binary spikes and update in an event-driven manner, aligning naturally with the SED nature of IMTS. Therefore, we present SEDformer, an SED-enhanced Spiking Transformer for telemetry IMTS forecasting that couples: (1) a SED-based Spike Encoder converts raw observations into event synchronous spikes using an Event-Aligned LIF neuron, (2) an Event-Preserving Temporal Downsampling module compresses long gaps while retaining salient firings and (3) a stack of SED-based Spike Transformer blocks enable intra-series dependency modeling with a membrane-based linear attention driven by EA-LIF spiking features. Experiments on public telemetry IMTS datasets show that SEDformer attains state-of-the-art forecasting accuracy while reducing energy and memory usage, providing a natural and efficient path for modeling IMTS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。