用自监督学习预测脑电图年龄,跨年龄范围表现优异。
STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning

- 基于时空掩码的自监督预训练,融合潜在表示预测与信号重建。
- 在3367个会话上实现3.06年误差,远超10年基准线。
- 适用于儿童到老年人群,适合脑健康研究与临床应用。
脑龄——从生理记录中推断出的年龄——是反映神经与精神负担的新生物标志物。脑电图(EEG)因其低成本、便携性及高时间分辨率成为理想载体。然而,现有模型面临跨站点电极布局差异、标注数据少和个体非平稳性等问题,且多数缺乏在儿童至老年全年龄段的竞争力。本文提出STST-JEPA,一种针对静息态与任务态EEG的自监督变压器,基于brain.space与HBN数据集中的47,703个会话(年龄5–81岁)进行预训练。模型采用潜表示预测目标,结合辅助信号重建项,对30秒多通道窗口施加时空块掩码。冻结预训练嵌入后,轻量级注意力探针在3,367个会话上达到3.06年平均绝对误差(r = 0.924),显著优于约10年基准。微调末层后,该编码器在NeuralBench x brain.space EEG排行榜上于30秒原生窗口下实现性别分类(平衡准确率0.911)、年龄预测(r = 0.749)和精神病理综合回归(r = 0.215)的顶尖排名。进一步发现,模型的年龄预测残差与认知效率呈负相关。
原文摘要 · Abstract (English)
Brain age - the age inferred from a physiological recording - is an emerging biomarker whose deviation from chronological age tracks neurological and psychiatric burden, and EEG is an attractive substrate for it because it is cheap, portable, and temporally rich. Yet EEG brain-age models must contend with cross-site montage heterogeneity, small labelled cohorts, and dominant subject-level non-stationarity, and few EEG foundation models have been shown to deliver competitive age regression across the full pediatric to older adult range in which such a biomarker would actually be deployed. We introduce STST-JEPA, a self-supervised transformer for resting-state and task EEG, pretrained on 47,703 sessions spanning ages 5-81 from the brain.space and Healthy Brain Network (HBN) corpora. The model combines a latent-prediction objective - predicting masked-token representations against an EMA-of-tokenizer target - with an auxiliary signal-reconstruction term, applied to 30-second multi-channel windows under spatiotemporal block masks. A lightweight attentive probe trained on frozen pretrained embeddings achieves a best held-out-validation mean absolute error of 3.06 years (r = 0.924) for age regression on 3,367 sessions, against a predict-the-mean baseline of approximately 10 years MAE. With light task-specific finetuning of the model's final layers, the same pretrained encoder achieves rank-1 placements - with the model's native 30-second windows - on the public NeuralBench x brain.space EEG leaderboard for sex classification (balanced accuracy 0.911), age prediction (r = 0.749), and psychopathology composite regression (r = 0.215). We further show that the model's age-prediction residual is negatively correlated with cognitive efficiency over several tasks we examined.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。