arXiv:2410.03533cs.NEcs.AI2024-10被引 6

用多尺度融合增强脉冲神经网络,实现高效低耗的脑机接口信号解码。

Multiscale fusion enhanced spiking neural network for invasive BCI neural signal decoding

  • 借鉴人脑视觉处理机制,通过多尺度特征融合提升解码能力。
  • 在两项侵入式脑机任务中,准确率和效率均优于MLP、GRU等传统模型。
  • 适合部署在类脑芯片上,为实时低功耗脑机接口提供新方案。

脑机接口(BCI)是神经科学与人工智能的前沿融合,需要稳定长期的神经信号解码。脉冲神经网络(SNN)因其神经元动态和基于脉冲的信号处理特性,天然适合该任务。本文提出一种多尺度融合增强的脉冲神经网络(MFSNN),模拟人类视觉感知中的并行处理与多尺度特征融合机制,实现实时、高效、节能的神经信号解码。MFSNN首先利用时序卷积网络与通道注意力机制从原始数据中提取时空特征,再通过跳跃连接融合特征以提升解码性能。此外,通过小批量监督泛化学习,增强了跨日信号解码的泛化性与鲁棒性。在单手抓握-触碰与中心-向外运动两项基准侵入式BCI任务中,MFSNN在准确率和计算效率上均超越传统人工神经网络(如MLP、GRU)。同时,其多尺度特征融合框架适合在类脑芯片上实现,为侵入式BCI信号的在线解码提供节能解决方案。

原文摘要 · Abstract (English)

Brain-computer interfaces (BCIs) are an advanced fusion of neuroscience and artificial intelligence, requiring stable and long-term decoding of neural signals. Spiking Neural Networks (SNNs), with their neuronal dynamics and spike-based signal processing, are inherently well-suited for this task. This paper presents a novel approach utilizing a Multiscale Fusion enhanced Spiking Neural Network (MFSNN). The MFSNN emulates the parallel processing and multiscale feature fusion seen in human visual perception to enable real-time, efficient, and energy-conserving neural signal decoding. Initially, the MFSNN employs temporal convolutional networks and channel attention mechanisms to extract spatiotemporal features from raw data. It then enhances decoding performance by integrating these features through skip connections. Additionally, the MFSNN improves generalizability and robustness in cross-day signal decoding through mini-batch supervised generalization learning. In two benchmark invasive BCI paradigms, including the single-hand grasp-and-touch and center-and-out reach tasks, the MFSNN surpasses traditional artificial neural network methods, such as MLP and GRU, in both accuracy and computational efficiency. Moreover, the MFSNN's multiscale feature fusion framework is well-suited for the implementation on neuromorphic chips, offering an energy-efficient solution for online decoding of invasive BCI signals.

脑机接口脉冲神经网络多尺度融合类脑计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。