arXiv:2603.16739cs.LGcs.AI2026-03被引 2

用频谱混合专家模型提升跨物种脑电解码能力

SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding

  • 在频谱图上联合施加时频高斯掩码,增强自监督预训练难度
  • 在人类与小鼠脑电数据上均实现顶尖解码性能
  • 适合跨物种、跨被试的脑电信号分析研究者使用

解码脑电图(EEG)中神经活动的协同模式是连接神经科学与人工智能的核心挑战。现有基础模型多依赖对原始信号进行独立的时间与频谱掩码进行自监督预训练,这类方法常使学习偏向高频振荡,因低频节律可轻易从未掩码信号中推断。本文提出一种新模型:基于短时傅里叶变换(STFT)图,采用高斯平滑掩码策略,在时间、频率和时频域同时施加掩码,显著增加重建难度,迫使模型学习高低频域的复杂神经模式。为高效恢复被强烈掩码的信号,设计了具有多级编码-解码结构的SpecHi-Net。为加速大规模预训练,将数据分为三组,分别训练独立专家模型,并通过由学习到的频谱门控机制引导的SpecMoE(混合专家)框架进行融合。SpecMoE在睡眠分期、情绪识别、运动想象分类、异常信号检测及药物效应预测等多项任务中达到当前最优表现,且在人类与小鼠脑电数据集上均展现优异的跨物种与跨被试泛化能力。

原文摘要 · Abstract (English)

Decoding the orchestration of neural activity in electroencephalography (EEG) signals is a central challenge in bridging neuroscience with artificial intelligence. Foundation models have made strides in generalized EEG decoding, yet many existing frameworks primarily relying on separate temporal and spectral masking of raw signals during self-supervised pretraining. Such strategies often tend to bias learning toward high-frequency oscillations, as low-frequency rhythmic patterns can be easily inferred from the unmasked signal. We introduce a foundation model that utilizes a novel Gaussian-smoothed masking scheme applied to short-time Fourier transform (STFT) maps. By jointly applying time, frequency, and time-frequency Gaussian masks, we make the reconstruction task much more challenging, forcing the model to learn intricate neural patterns across both high- and low-frequency domains. To effectively recover signals under this aggressive masking strategy, we design SpecHi-Net, a U-shaped hierarchical architecture with multiple encoding and decoding stages. To accelerate large-scale pretraining, we partition the data into three subsets, each used to train an independent expert model. We then combine these models through SpecMoE, a mixture of experts framework guided by a learned spectral gating mechanism. SpecMoE achieves state-of-the-art performance across a diverse set of EEG decoding tasks, including sleep staging, emotion recognition, motor imagery classification, abnormal signal detection, and drug effect prediction. Importantly, the model demonstrates strong cross-species and cross-subject generalization, maintaining high accuracy on both human and murine EEG datasets.

脑电解码混合专家跨物种

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。