arXiv:2505.15840cs.NEcs.AI2025-05

提出新型脉冲网络模型,用自上而下反馈提升时序信息利用。

TDFormer: A Top-Down Attention-Controlled Spiking Transformer

  • 设计自上而下反馈结构,增强跨时间步信息传递
  • 在ImageNet上达86.83%准确率,性能领先
  • 适用于需高效处理时序数据的脉冲神经网络任务

传统脉冲神经网络(SNN)可视为多个子网络在单个时间步运行的组合,参数共享,膜电位是唯一的信息连接。然而膜电位的隐式特性限制了其对时序信息的有效表达,导致各时间步无法充分利用前序信息,严重制约模型性能。受大脑自上而下机制启发,本文提出TDFormer,一种具有自上而下反馈结构的新模型,能分层利用早期时间步的高阶表征,调节后期低阶信息处理。该结构在前向传播中增加时间步间的互信息,表明更丰富的时序信息被传递与整合;在反向传播中,理论上证明反馈结构缓解了时间维度上的梯度消失问题。两者协同显著且一致地提升多数据集表现,尤其在ImageNet上达到86.83%的准确率,处于当前最优水平。

原文摘要 · Abstract (English)

Traditional spiking neural networks (SNNs) can be viewed as a combination of multiple subnetworks with each running for one time step, where the parameters are shared, and the membrane potential serves as the only information link between them. However, the implicit nature of the membrane potential limits its ability to effectively represent temporal information. As a result, each time step cannot fully leverage information from previous time steps, seriously limiting the model's performance. Inspired by the top-down mechanism in the brain, we introduce TDFormer, a novel model with a top-down feedback structure that functions hierarchically and leverages high-order representations from earlier time steps to modulate the processing of low-order information at later stages. The feedback structure plays a role from two perspectives: 1) During forward propagation, our model increases the mutual information across time steps, indicating that richer temporal information is being transmitted and integrated in different time steps. 2) During backward propagation, we theoretically prove that the feedback structure alleviates the problem of vanishing gradients along the time dimension. We find that these mechanisms together significantly and consistently improve the model performance on multiple datasets. In particular, our model achieves state-of-the-art performance on ImageNet with an accuracy of 86.83%.

脉冲神经网络时序建模反馈机制图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。