arXiv:2502.06438cs.LGcs.AI2025-02被引 18

用双向Mamba模型实现高效可扩展的脑电分析,适合穿戴设备部署。

FEMBA: Efficient and Scalable EEG Analysis with a Bidirectional Mamba Foundation Model

  • 采用双向状态空间建模,计算复杂度线性增长,突破Transformer瓶颈。
  • 在TUAB数据集上达81.82%平衡准确率,TUAR上0.949 AUROC。
  • 仅780万参数的小模型适配资源受限设备,适合临床与可穿戴场景。

精准高效的脑电图(EEG)分析对长期监测中的癫痫和伪迹检测至关重要,应用涵盖医院诊断到可穿戴健康设备。然而,传统深度学习模型尤其是基于Transformer的架构受制于二次时间与内存复杂度,难以在资源受限环境中使用。为此,我们提出FEMBA(基础型脑电Mamba + 双向架构),一种新型自监督框架,通过双向状态空间建模建立脑电分析的新效率基准。与Transformer的二次复杂度不同,FEMBA随序列长度呈线性增长,实现更可扩展、高效的长时脑电处理。该模型在超过21,000小时无标签脑电数据上预训练,并在三个下游任务上微调,性能媲美变压器模型,但计算成本显著更低。具体而言,在TUAB数据集上达到81.82%平衡准确率(0.8921 AUROC),在TUAR数据集上达0.949 AUROC;其仅780万参数的轻量版本展现出在资源受限设备上的可行性。这些结果为临床与可穿戴场景下的可扩展通用脑电分析铺平道路,凸显FEMBA在可穿戴应用中的巨大潜力。

原文摘要 · Abstract (English)

Accurate and efficient electroencephalography (EEG) analysis is essential for detecting seizures and artifacts in long-term monitoring, with applications spanning hospital diagnostics to wearable health devices. Robust EEG analytics have the potential to greatly improve patient care. However, traditional deep learning models, especially Transformer-based architectures, are hindered by their quadratic time and memory complexity, making them less suitable for resource-constrained environments. To address these challenges, we present FEMBA (Foundational EEG Mamba + Bidirectional Architecture), a novel self-supervised framework that establishes new efficiency benchmarks for EEG analysis through bidirectional state-space modeling. Unlike Transformer-based models, which incur quadratic time and memory complexity, FEMBA scales linearly with sequence length, enabling more scalable and efficient processing of extended EEG recordings. Trained on over 21,000 hours of unlabeled EEG and fine-tuned on three downstream tasks, FEMBA achieves competitive performance in comparison with transformer models, with significantly lower computational cost. Specifically, it reaches 81.82% balanced accuracy (0.8921 AUROC) on TUAB and 0.949 AUROC on TUAR, while a tiny 7.8M-parameter variant demonstrates viability for resource-constrained devices. These results pave the way for scalable, general-purpose EEG analytics in both clinical and highlight FEMBA as a promising candidate for wearable applications.

脑电分析Mamba模型可穿戴高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。