将脑电图大模型部署到超低功耗芯片,实现长期精准监测。
FEMBA on the Edge: Physiologically-Aware Pre-Training, Quantization, and Deployment of a Bidirectional Mamba EEG Foundation Model on an Ultra-low Power Microcontroller
- 用生理感知预训练提升脑电信号质量,聚焦有效神经振荡。
- 2比特量化压缩模型,性能损失极小,内存减少74%至约2MB。
- 首次在超低功耗芯片上实现实时推理,适合癫痫与睡眠疾病监测。
目标:通过克服基于Transformer的脑电图(EEG)基础模型的计算瓶颈和状态空间模型(SSMs)固有的量化挑战,实现可穿戴设备上的持续长期神经监测。方法:我们提出FEMBA,一种在超过21,000小时的EEG数据上预训练的双向Mamba架构。引入新颖的生理感知预训练目标,包含低通滤波重建,以优先保留神经振荡而非高频伪迹。针对SSMs中常见的激活异常值问题,采用量化感知训练(QAT)将模型压缩至2比特权重。框架在并行超低功耗RISC-V微控制器(GAP9)上部署,使用自定义双缓冲内存流方案。结果:所提出的低通预训练使下游TUAB数据集的AUROC从0.863提升至0.893,AUPR从0.862提升至0.898,优于最佳对比基线。QAT成功压缩权重且性能损失可忽略,而标准后训练量化导致准确率下降约30%。嵌入式实现达到确定性实时推理(每5秒窗口1.70秒),内存占用减少74%(约2MB),相比Transformer基准最多节省27倍浮点运算量,同时保持竞争性精度。结论:FEMBA表明,基于Mamba的基础模型可在不牺牲临床分析所需表征质量的前提下,有效量化并部署于极端边缘硬件。意义:本工作建立了首个完整栈的大型EEG基础模型在超低功耗可穿戴设备上的部署框架,推动癫痫与睡眠障碍的持续、基于SSM的监测。
原文摘要 · Abstract (English)
Objective: To enable continuous, long-term neuro-monitoring on wearable devices by overcoming the computational bottlenecks of Transformer-based Electroencephalography (EEG) foundation models and the quantization challenges inherent to State-Space Models (SSMs). Methods: We present FEMBA, a bidirectional Mamba architecture pre-trained on over 21,000 hours of EEG. We introduce a novel Physiologically-Aware pre-training objective, consisting of a reconstruction with low-pass filtering, to prioritize neural oscillations over high-frequency artifacts. To address the activation outliers common in SSMs, we employ Quantization-Aware Training (QAT) to compress the model to 2-bit weights. The framework is deployed on a parallel ultra-low-power RISC-V microcontroller (GAP9) using a custom double-buffered memory streaming scheme. Results: The proposed low-pass pre-training improves downstream AUROC on TUAB from 0.863 to 0.893 and AUPR from 0.862 to 0.898 compared to the best contrastive baseline. QAT successfully compresses weights with negligible performance loss, whereas standard post-training quantization degrades accuracy by approximately \textbf{30\%}. The embedded implementation achieves deterministic real-time inference (\textbf{1.70~s} per 5~s window) and reduces the memory footprint by \textbf{74\%} (to $\approx$2~MB), achieving competitive accuracy with up to \textbf{27$\times$} fewer FLOPs than Transformer benchmarks. Conclusion: FEMBA demonstrates that Mamba-based foundation models can be effectively quantized and deployed on extreme-edge hardware without sacrificing the representation quality required for robust clinical analysis. Significance: This work establishes the first full-stack framework for deploying large-scale EEG foundation models on ultra-low-power wearables, facilitating continuous, SSM based monitoring for epilepsy and sleep disorders.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。