将神经科学原理融入模型,让脑电基础模型更通用。
DeeperBrain: A Neuro-Grounded EEG Foundation Model Towards Universal BCI
- 结合神经电生理特性设计结构与目标函数
- 冻结推理下仍保持领先性能,验证通用性
- 适合脑机接口、神经解码等研究者使用
脑电图(EEG)基础模型在通用脑-机接口(BCI)中具有巨大潜力。然而,现有方法多依赖端到端微调,在冻结探针协议下表现有限,缺乏广泛泛化所需的内在通用性。这源于采用通用序列架构而忽视神经活动的生物物理与动力学规律。为此,我们提出DeeperBrain,一种融合领域特定归纳偏置的神经科学奠基模型,其架构包含考虑体积传导的通道编码,通过三维几何建模空间混合;以及捕捉慢适应的神经动力学感知时序编码,使用振荡和指数基底。预训练采用双重目标策略:掩码脑电信号重建(MER)保证局部保真度,神经动力学统计预测(NSP)通过预测可解释的序参量(如谱功率、功能连接、跨频耦合、动态复杂性)实现宏观脑状态对齐。大量实验表明,DeeperBrain在端到端微调下达到先进或竞争力水平;更重要的是,在严格的冻结探针协议下仍保持优异性能,验证了嵌入神经科学先验知识使学习表征具备通用脑机接口所需的内在通用性。代码将公开。
原文摘要 · Abstract (English)
Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing protocols, lacking the intrinsic universality required for broad generalization. This limitation stems from adapting general-purpose sequence architectures that overlook the biophysical and dynamical principles of neural activity. To bridge this gap, we propose DeeperBrain, a neuro-grounded foundation model integrating domain-specific inductive biases into its model design and learning objectives. Architecturally, DeeperBrain incorporates a volume conduction-aware channel encoding to model spatial mixing via 3D geometry, and a neurodynamics-aware temporal encoding capturing slow adaptations using oscillatory and exponential bases. For pretraining, we introduce a dual-objective strategy combining Masked EEG Reconstruction (MER) for local fidelity and Neurodynamics Statistics Prediction (NSP). NSP enforces alignment with macroscopic brain states by predicting interpretable order parameters, including spectral power, functional connectivity, cross-frequency coupling, and dynamic complexity. Extensive experiments demonstrate that DeeperBrain achieves state-of-the-art or highly competitive performance under end-to-end fine-tuning. Crucially, it maintains superior efficacy under a rigorous frozen-probing protocol, verifying that embedding neuroscientific first principles endows learned representations with the intrinsic universality essential for universal BCI. The code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。