CodeBrain通过解耦时频信号与多尺度结构,提升脑电模型的可解释性与泛化能力。
CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation Model
- 解耦时频信号生成离散令牌,扩大表示空间以增强区分力。
- 多尺度EEGSSM高效捕捉长程与局部依赖,适配脑网络小世界特性。
- 在8个任务10个数据集上表现优异,支持分布外泛化与可解释性分析。
脑电图(EEG)提供大脑活动的实时洞察,在神经科学中有广泛应用。尽管脑电基础模型(EFMs)已出现以解决特定任务模型的可扩展性问题,但现有方法仍产生临床不可解释、判别力弱的表示,未能有效捕捉全局依赖,也忽略了重要的局部神经事件。本文提出两阶段的脑电基础模型CodeBrain。第一阶段引入TFDual-Tokenizer,将异质的时序与频率脑电信号解耦为离散令牌,使表示空间扩大四倍,增强判别力,并通过提示潜在神经事件与谱节律关联实现表征级可解释性。第二阶段提出多尺度EEGSSM架构,结合结构化全局卷积与滑动窗口注意力,高效捕获稀疏长程与局部依赖,反映大脑的小世界拓扑结构。CodeBrain在最大公开脑电语料库上预训练,跨8个下游任务和10个数据集在分布外情形下表现强泛化能力,经全面消融实验、缩放定律分析及可解释性评估验证。代码与预训练权重见https://github.com/jingyingma01/CodeBrain。
原文摘要 · Abstract (English)
Electroencephalography (EEG) provides real-time insights into brain activity and supports diverse applications in neuroscience. While EEG foundation models (EFMs) have emerged to address the scalability issues of task-specific models, current approaches still yield clinically uninterpretable and weakly discriminative representations, inefficiently capturing global dependencies and neglecting important local neural events. We present CodeBrain, a two-stage EFM designed to fill this gap. In the first stage, we introduce the TFDual-Tokenizer, which decouples heterogeneous temporal and frequency EEG signals into discrete tokens, quadratically expanding the representation space to enhance discriminative power and offering domain-specific representation-level interpretability by suggesting potential links to neural events and spectral rhythms. In the second stage, we propose the multi-scale EEGSSM architecture, which combines structured global convolution with sliding window attention to efficiently capture both sparse long-range and local dependencies, reflecting the brain's small-world topology. Pretrained on the largest public EEG corpus, CodeBrain achieves strong generalization across eight downstream tasks and ten datasets under distribution shifts, supported by comprehensive ablations, scaling-law analyzes, and interpretability evaluations. The code and the pretrained weights are available at https://github.com/jingyingma01/CodeBrain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。