arXiv:2603.16281cs.LGq-bio.NC2026-03被引 2

用潜在表示预测替代信号重建,提升脑电图模型的临床实用性

Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstruction

  • 采用LeJEPA框架,通过预测潜在表征而非重建原始信号
  • 在冻结线性探测下实现最强临床准确率,对微弱神经模式更敏感
  • 适合需要鲁棒脑电分析的临床诊断与脑机接口研究

脑电图(EEG)广泛用于神经科学、临床诊断和脑机接口。现有大规模无标签预训练脑电基础模型虽旨在学习可迁移表征,但性能提升有限,对下游适配策略敏感,且在线性探测下表现受限。我们假设原因在于依赖信号重建作为主要自监督目标,导致表征偏向高方差伪影而非任务相关神经结构。为此,我们探索基于联合嵌入预测架构(JEPA)的自监督范式,通过预测潜在表示来学习。提出Laya,首个基于LeJEPA的脑电基础模型。结果显示,潜在预测生成的表征能捕捉脑电信号的语义结构:其嵌入可追踪癫痫发作等临床状态变化,抗噪能力强,在冻结线性探测下达到最高平均临床准确率,尤其在细微神经模式易被伪影掩盖的任务中优势显著。与匹配的MAE变体对比的受控消融实验表明,预训练目标的选择是性能提升的主要因素,而非架构或数据。

原文摘要 · Abstract (English)

Electroencephalography (EEG) is a widely used tool for studying brain function, with applications in clinical neuroscience, diagnosis, and brain-computer interfaces (BCIs). Recent EEG foundation models trained on large unlabeled corpora aim to learn transferable representations, but their effectiveness remains unclear; reported improvements over smaller task-specific models are often modest, sensitive to downstream adaptation and fine-tuning strategies, and limited under linear probing. We hypothesize that one contributing factor is the reliance on signal reconstruction as the primary self-supervised learning (SSL) objective, which biases representations toward high-variance artifacts rather than task-relevant neural structure. To address this limitation, we explore an SSL paradigm based on Joint Embedding Predictive Architectures (JEPA), which learn by predicting latent representations instead of reconstructing raw signals. We introduce Laya, the first EEG foundation model based on LeJEPA. We show that latent prediction yields representations that encode semantic structure in EEG: Laya embeddings track clinically meaningful state changes such as seizure onset, are resilient to noise, and achieve the strongest mean clinical accuracy under frozen linear probing, with particular gains on tasks where relevant neural patterns are subtle and easily obscured by artifacts. Controlled ablations against matched MAE variants confirm that the choice of pretraining objective, rather than architecture or data, is the primary driver of these gains.

脑电图自监督学习神经表征临床应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。