用因果状态空间模型实现脑电波实时连续分析,速度超现有方法10倍。
CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Models

- 基于因果Mamba结构,线性处理长序列脑电信号。
- 在3个数据集上达最新水平,推理速度提升10倍以上。
- 专为短事件长间隔设计训练流程,适合实时脑机接口应用。
脑电图(EEG)是监测大脑电活动的关键非侵入性方法,其信号长度可从几秒到数小时不等,给现有深度学习方法带来挑战:(1)主流模型依赖注意力机制,序列变长时计算量呈二次增长;(2)原始信号需分段滑窗处理,无法全局理解。为此,我们提出CaMBRAIN——首个基于因果Mamba的状态空间模型,专为实时脑电推断设计,主张双向建模对具有单向时序特性的脑电信号而言过于昂贵。但此类模型训练困难,因关键脑电事件可能仅持续分数秒,却相隔数分钟。现有自监督方法侧重信号重建,不适合流式状态空间模型,无法有效训练隐藏状态保留长程上下文。因此,我们设计多阶段自监督训练流程,专门强化长程记忆能力,在保持线性时间复杂度的前提下,显著提升性能。CaMBRAIN在3个不同脑电数据集上达到当前最优结果,推理吞吐量超过现有模型10倍以上,首次实现对变长脑电信号的长程连续推断。
原文摘要 · Abstract (English)
Electroencephalography (EEG) is a critical, non-invasive method to monitor electrical brain activity. EEGs can span anywhere from a couple seconds to multiple hours, posing a major hurdle for existing deep learning methods due to two major factors: (1) existing EEG models are predominantly built upon the attention mechanism, incurring quadratic scaling as the sequence length increases, and (2) raw EEG signals must be processed in a sliding-window fashion due to fixed-length input requirements, preventing global understanding of the entire signal. To this extent, we propose CaMBRAIN - the first Causal, Mamba-based state space model (SSM) capable of real-time inference of EEG signals, arguing that bidirectional approaches are needlessly expensive given the causal, unidirectional nature of EEG. However, training such a model is non-trivial, as crucial EEG events can be extremely brief - within fractions of a second - yet separated by long intervals spanning minutes. Current EEG methods use self-supervised objectives that optimize for signal reconstruction, but these are not well suited for streaming SSMs; they fail to explicitly train the hidden state to retain the salient long-range context needed for streaming inference. We therefore introduce a multi-stage self-supervised training pipeline specifically tailored to encourage long-range memory retention and strong performance on EEG signals, while preserving the linear-time complexity of state space models. CaMBRAIN achieves state-of-the-art (SOTA) results across 3 different EEG datasets with >10x higher throughput than existing models, enabling the first model capable of long-range, continuous inference of variable-length EEG signals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。