提出分层交互双流网络,提升脑电解码的时空特征融合效率。
LI-DSN: A Layer-wise Interactive Dual-Stream Network for EEG Decoding
- 在每层实现时序与空间流的渐进式交叉通信
- 在8个数据集上优于13个主流模型,最高提升5.2%
- 适合需要高精度脑机接口的应用场景
脑电图(EEG)为非侵入性观测脑活动提供了高时间分辨率,对脑机接口(BCIs)理解与交互神经过程至关重要。现有双流神经网络通常独立处理时序和空间特征,在后期才进行融合,导致信息孤岛问题,限制了中间阶段的跨流优化,阻碍了时空特征的充分解耦。本文提出分层交互双流网络(LI-DSN),在每一层实现时序与空间流的渐进式交互,克服晚融合范式的局限。LI-DSN引入新颖的时序-空间融合注意力(TSIA)机制,构建空间关联相关矩阵(SACM)以捕捉电极间的空间结构关系,并设计时序通道聚合矩阵(TCAM)在空间引导下整合余弦门控的时序动态。此外,采用可学习通道权重的自适应融合策略优化双流特征集成。在涵盖运动想象分类、情绪识别和稳态视觉诱发电位(SSVEP)的8个不同脑电数据集上进行大量实验,结果表明LI-DSN显著优于13个当前最优(SOTA)基线模型,展现出更强的鲁棒性与解码性能。
原文摘要 · Abstract (English)
Electroencephalography (EEG) provides a non-invasive window into brain activity, offering high temporal resolution crucial for understanding and interacting with neural processes through brain-computer interfaces (BCIs). Current dual-stream neural networks for EEG often process temporal and spatial features independently through parallel branches, delaying their integration until a final, late-stage fusion. This design inherently leads to an "information silo" problem, precluding intermediate cross-stream refinement and hindering spatial-temporal decompositions essential for full feature utilization. We propose LI-DSN, a layer-wise interactive dual-stream network that facilitates progressive, cross-stream communication at each layer, thereby overcoming the limitations of late-fusion paradigms. LI-DSN introduces a novel Temporal-Spatial Integration Attention (TSIA) mechanism, which constructs a Spatial Affinity Correlation Matrix (SACM) to capture inter-electrode spatial structural relationships and a Temporal Channel Aggregation Matrix (TCAM) to integrate cosine-gated temporal dynamics under spatial guidance. Furthermore, we employ an adaptive fusion strategy with learnable channel weights to optimize the integration of dual-stream features. Extensive experiments across eight diverse EEG datasets, encompassing motor imagery (MI) classification, emotion recognition, and steady-state visual evoked potentials (SSVEP), consistently demonstrate that LI-DSN significantly outperforms 13 state-of-the-art (SOTA) baseline models, showcasing its superior robustness and decoding performance. The code will be publicized after acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。