统一建模脑电与神经放电信号,提升脑机接口泛化能力
iBrain: A Unified Foundation Model Reading the Brain from Surface to Spikes

- 用专用编码器处理不同信号,共享时空变换器捕捉跨通道依赖
- 在7000小时异构数据上预训练,实现跨模态信号重建与对齐
- 支持跨场景迁移,显著提升下游任务的数据效率与性能
侵入式神经记录提供高保真脑活动测量,如颅内脑电(iEEG)和皮层内放电信号,分别反映不同空间与时间尺度的神经动态。然而现有神经基础模型多针对单一记录方式独立开发,跨异构信号联合预训练仍缺乏探索。本文提出iBrain,一个统一的基础模型,可联合学习iEEG与放电信号。iBrain采用信号特异性编码器适应其差异特征,并以共享时空变换器建模通道间与时间上的依赖关系。我们在超过7,000小时的异构神经记录上,通过掩码信号重建与通道视图对齐进行预训练,增强神经动态的上下文建模能力及对不同通道的鲁棒性。iBrain在多个基准测试中持续优于单信号预训练基线,达到当前最优性能。进一步实验表明,iBrain具备跨记录场景的可迁移性与数据高效性。结果表明,对异构侵入式神经信号进行联合预训练,有助于实现可扩展的神经建模与跨设置、下游任务的可转移表征。
原文摘要 · Abstract (English)
Invasive neural recordings provide high-fidelity measurements of brain activity, with signals such as intracranial EEG (iEEG) and intracortical spiking activity capturing neural dynamics at different spatial and temporal scales. Yet existing neural foundation models have largely been developed independently for different invasive recording paradigms, leaving joint pretraining across heterogeneous invasive signals underexplored. In this work, we introduce iBrain, a unified foundation model that jointly learns from iEEG and spiking activity. iBrain employs signal-specific encoders to accommodate their distinct signal characteristics and a shared spatiotemporal Transformer backbone to model dependencies across recording channels and time. We pretrain iBrain on over 7,000 hours of heterogeneous neural recordings using masked signal reconstruction and channel-view alignment, promoting contextual modeling of neural dynamics and robustness across different channels. iBrain consistently outperforms single-signal pretraining baselines and achieves state-of-the-art performance on multiple benchmarks. Further experiments demonstrate that iBrain exhibits transferability and data efficiency across diverse recording settings. These results highlight the potential of joint pretraining on heterogeneous invasive neural recordings to support scalable neural modeling and transferable representations across recording settings and downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。