用混合神经网络解码脑电波想象说话,准确率达80.13%。
EEG-Based Imagined Speech Decoding Using a Hybrid CNN-SNN Architecture

- 先用CNN提取时间特征,再用脉冲神经网络进行生物启发分类
- 在2020年BCI竞赛数据上达到80.13%准确率,优于此前最高70.19%
- 首次将脉冲神经网络用于脑电想象言语解码,适合神经形态接口研究者
利用脑电图(EEG)信号解码想象中的言语已成为脑机接口(BCI)研究的重要方向,尤其适用于严重言语障碍者的沟通恢复。然而,由于EEG信号具有非平稳性、低幅值和高度可变性的特点,解码想象言语仍具挑战。现有方法多依赖传统机器学习或深度学习模型,未能充分利用生物神经元的脉冲式时间动态与事件驱动放电机制,而这些特性天然由脉冲神经网络(SNNs)建模。本研究提出一种混合解码流程:先用卷积神经网络(CNN)提取时间表征,再通过生物启发的脉冲神经网络进行时序分类。据我们所知,这是首个将SNN应用于基于EEG的想象言语解码的研究。实验结果表明,所提的CNN-SNN架构在2020年BCI竞赛第三阶段基准测试中取得80.13%的准确率,超越文献中已报道方法(最高达70.19%),在相同评估条件下表现更优。这些发现验证了基于脉冲的时间解码在想象言语任务中的有效性,凸显了生物基础型处理流程在下一代神经形态脑机接口应用中的潜力。
原文摘要 · Abstract (English)
Imagined speech decoding using EEG signals has emerged as a promising frontier in brain-computer interface (BCI) research, particularly to restore communication for individuals with severe speech impairments. However, decoding imagined speech remains a complex task due to the non-stationary, low-amplitude, and highly variable nature of EEG signals. Existing methods often rely on classical machine learning or deep learning models that fail to exploit spike-based temporal dynamics or event-driven firing mechanisms of biological neurons, which are naturally modeled by spiking neural networks (SNNs). In this study, we propose a hybrid decoding pipeline that extracts temporal representations using convolutional neural networks (CNNs) followed by biologically inspired temporal classification via SNNs. To our knowledge, this is the first study to integrate SNNs into EEG-based imagined speech decoding. Experimental results show that the proposed CNN-SNN architecture achieves an accuracy of 80.13% on the 2020 BCI Competition III benchmark, surpassing existing methods reported in the literature (up to 70.19%) under comparable evaluation settings. These findings demonstrate the effectiveness of spike-based temporal decoding for imagined speech, highlighting the promise of biologically grounded pipelines for next generation neuromorphic BCI applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。