用结构化隐状态预测提升脑电基础模型的可迁移性
EEG-JEPA: Structured Latent Prediction for EEG Foundation Models

- 不直接重建脑电信号,而是预测结构化电极-时间区域的隐状态
- 在基准测试上冻结微调准确率提升至52.94%,为当前最高
- 适合研究脑电表征学习、跨任务迁移的学者参考
脑电图(EEG)基础模型旨在从大规模无标签记录中学习可复用的表征。传统预训练方法采用掩码波形重建,但直接对噪声大的脑电信号施加监督,可能导致模型学习到可预测的背景活动、采集效应和伪影,而非跨任务可迁移的神经结构。核心问题在于:EEG基础模型应预测什么?本文提出EEG-JEPA,一种基于结构化隐状态预测的脑电基础建模框架。不同于直接重建被掩码的电压样本,该框架通过掩码上下文编码器与预测器,推断由指数移动平均目标编码器生成的完整输入上下文隐状态。目标设计沿三个互补维度展开:目标内容定义预测的表征类型,目标支持通过神经拓扑感知多尺度电极-时间掩码(N-MET)确定预测位置,目标深度指定监督应用于编码器的哪一层。三者协同将预训练从恢复缺失测量转向从结构化电极-时间上下文中推断隐状态。我们在控制性客观比较、冻结多任务迁移及全微调下评估了EEG-JEPA。在相同主干网络、预训练语料库和训练时长下,相较于CBraMod风格的掩码波形重建,其14任务冻结微调宏平均准确率从40.49%提升至50.42%;多源延续进一步达52.94%,为当前在EEG-FM-Bench上评估的最高均值。在协议匹配的全微调下,九任务平均平衡准确率也从68.98%提升至70.65%。
原文摘要 · Abstract (English)
Electroencephalography (EEG) foundation models aim to learn reusable representations from large-scale unlabeled recordings. A common pretraining strategy is masked waveform reconstruction, but applying supervision directly to noisy EEG may encourage models to recover predictable background activity, acquisition effects, and artifacts rather than neural structure that transfers across tasks. This raises a central question: what should an EEG foundation model predict to learn transferable representations? We introduce EEG-JEPA a structured latent-prediction framework for EEG foundation modeling. Rather than reconstructing masked voltage samples, a masked context encoder and predictor infer contextual latent states produced by an exponential-moving-average target encoder that observes the complete input. EEG-JEPA organizes target design along three complementary dimensions: target content specifies what representation is predicted, target support specifies where prediction occurs over structured electrode--time regions through Neurotopology-Aware Multi-scale Electrode-Temporal Masking (N-MET), and target depth specifies at which encoder layers supervision is applied. Together, these designs shift EEG pretraining from recovering missing measurements to inferring latent states from structured electrode--time context. We evaluate EEG-JEPA through controlled objective comparisons, frozen multitask transfer, and full fine-tuning. Under the same backbone, pretraining corpus, and training duration, EEG-JEPA improves the 14-task frozen macro balanced accuracy from 40.49% to 50.42% over CBraMod-style masked waveform reconstruction. Multi-source continuation further raises this result to 52.94%, the highest average among the EEG foundation models evaluated on EEG-FM-Bench. Under protocol-matched full fine-tuning, EEG-JEPA also improves the nine-task average balanced accuracy from 68.98% to 70.65%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。