基于脑科学机制的统一脑电模型,显著提升脑信号理解能力
Uni-NTFM: A Unified Foundation Model for EEG Signal Representation Learning
- 融合生物神经机制设计新架构,兼顾时频特征编码
- 在9个下游任务中超越现有模型,参数达19亿创纪录
- 适合脑机接口、神经疾病研究等需要精准解码的场景
当前脑电(EEG)基础模型多借鉴计算机视觉或自然语言处理架构,将神经信号视为像素网格或词元序列,忽视了大脑皮层复杂拓扑结构下多样稀疏编码的特性。受生物神经机制启发,我们提出统一神经拓扑基础模型(Uni-NTFM),其架构基于三大神经科学原理。为匹配大脑解耦编码机制,设计异质特征投影模块,同步编码时域非平稳瞬变与频域稳态节律,确保波形形态与谱节奏高质量。引入拓扑嵌入机制,注入结构化空间先验,将不同传感器配置对齐至统一潜在功能拓扑,有效重建脑区几何结构。通过构建专家混合变换器网络,实现功能模块化与生物网络稀疏编码效率,动态路由机制将不同信号模式与任务分配给专业子网络,防止任务干扰,同时将模型容量提升至创纪录的19亿参数。Uni-NTFM在包含28,000小时脑电数据的多样化语料上预训练,在线性探测与微调设置下均优于现有模型,在9项下游任务中表现卓越,证明模型架构与神经机制对齐对于学习通用表征和实现可泛化脑解码至关重要。
原文摘要 · Abstract (English)
Current foundation models for electroencephalography (EEG) rely on architectures adapted from computer vision or natural language processing, typically treating neural signals as pixel grids or token sequences. This approach overlooks that the neural activity is activated by diverse sparse coding across a complex geometric topological cortex. Inspired by biological neural mechanisms, we propose the Unified Neural Topological Foundation Model (Uni-NTFM), an architecture rooted in three core neuroscience principles. In detail, to align with the brain's decoupled coding mechanism, we design the Heterogeneous Feature Projection Module. This module simultaneously encodes both time-domain non-stationary transients and frequency-domain steady-state rhythms, ensuring high quality in both waveform morphology and spectral rhythms. Moreover, we introduce a Topological Embedding mechanism to inject structured spatial priors and align different sensor configurations onto a unified latent functional topography, effectively reconstructing the geometry of brain regions. Furthermore, we achieve functional modularization and sparse coding efficiency of biological networks by constructing the Mixture-of-Experts Transformer network. This dynamic routing mechanism assigns different signal patterns and tasks to specialized neural subnetworks, and effectively preventing task interference while increasing the model capacity to record-breaking 1.9 billion parameters. Uni-NTFM is pre-trained on a diverse corpus comprising 28,000 hours of EEG data, and outperforms existing models across nine distinct downstream tasks under both linear probing and fine-tuning settings, demonstrating that aligning model architecture with neural mechanisms is significant to learn universal representations and achieve generalizable brain decoding. Our code is available at: https://anonymous.4open.science/r/Uni-NTFM-0924.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。