用线性复杂度模型高效建模长时序脑电,兼顾时序与频谱特征。
An Efficient Self-Supervised Framework for Long-Sequence EEG Modeling
- 采用Mamba-2的U形架构,实现线性计算复杂度,降低内存占用。
- 结合L1与傅里叶损失重建原始脑电信号,保留时序与频谱特性。
- 在跨被试、跨任务、跨域场景下表现优异,适合部署于低资源脑机接口设备。
脑电(EEG)信号通常信噪比低且个体差异大,跨被试和跨域泛化困难。近年来基于Transformer的自监督学习在脑电表征学习中展现出潜力,但其二次计算复杂度导致内存占用高、推理慢,难以建模长时依赖。现有方法多聚焦显式时间窗口分割或仅使用频谱输入,忽视原始时序动态。本文提出EEGM2,一种自监督框架,采用集成Mamba-2的U形编码器-解码器结构,实现线性计算复杂度,显著降低内存消耗并提升推理速度。Mamba-2的选通信息传播机制可有效捕捉并保留原始脑电信号中的长程依赖,优于传统RNN或CNN。同时,EEGM2设计联合L1与傅里叶基谱损失的自监督预训练目标,通过重建原始信号增强泛化能力。实验表明,EEGM2在短序列与长序列建模分类中均达当前最优性能,且在跨被试、跨任务及跨域场景下具强泛化性与可迁移性。整体上,EEGM2为资源受限的脑机接口(BCI)设备提供了一种高效可扩展的解决方案。
原文摘要 · Abstract (English)
Electroencephalogram (EEG) signals generally exhibit low signal-to-noise ratio (SNR) and high inter-subject variability, making generalization across subjects and domains challenging. Recent advances in deep learning, particularly self-supervised learning with Transformer-based architectures, have shown promise in EEG representation learning. However, their quadratic computational complexity increases memory usage and slows inference, making them inefficient for modeling long-range dependencies. Moreover, most existing approaches emphasize either explicit window segmentation of the temporal signal or spectral-only input embedding while neglecting raw temporal dynamics. In this paper, we propose EEGM2, a self-supervised framework that overcomes these limitations. EEGM2 adopts a U-shaped encoder-decoder architecture integrated with Mamba-2 to achieve linear computational complexity, thereby reducing memory usage and improving inference speed. Meanwhile, the selective information propagation mechanism of Mamba-2 enables the model to effectively capture and preserve long-range dependencies in raw EEG signals, where traditional RNN or CNN architectures often struggle. Moreover, EEGM2 employs a self-supervised pre-training objective that reconstructs raw EEG using a combined L1 and spectral (Fourier-based) loss, enhancing generalization by jointly preserving temporal dynamics and spectral characteristics. Experimental results demonstrate that EEGM2 achieves state-of-the-art performance in both short- and long-sequence modeling and classification. Further evaluations show that EEGM2 consistently outperforms existing models, demonstrating strong generalization across subjects and tasks, as well as transferability across domains. Overall, EEGM2 offers an efficient and scalable solution suitable for deployment on resource-constrained brain-computer interface (BCI) devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。