用头皮脑电预训练模型,让颅内脑电解码更高效、适配新患者更快。
CORTEG: Foundation Models Enable Cross-Modality Representation Transfer from Scalp to Intracranial Brain Recordings

- 用预训练的头皮脑电模型迁移适配颅内脑电信号
- 在9人和16人数据上表现优于或相当主流方法
- 单机10-30分钟即可完成新患者校准,适合临床部署
颅内皮层脑电图(ECoG)为脑机接口提供了高信噪比的皮层活动信号,但每名患者的可用数据有限,导致以往工作多依赖小样本、个体特异的解码器,忽略了跨患者共享信息。本文研究大型预训练头皮脑电基础模型(EEG FMs)能否被适配用于ECoG,实现跨患者学习,并在单块GPU上仅用10-30分钟完成对新患者的校准,同时保持竞争力的解码性能。我们提出CORTEG框架,结合预训练的EEG FM主干网络、电极感知的KNNSoftFourier空间适配器、针对低频与高γ活动的双流分词器,以及留一被试者交叉验证微调策略。在两个挑战性回归任务上评估:公开手指轨迹回归(n=9)和私有音频包络回归(n=16)。CORTEG在两项任务上均达到或超过最强任务特定基线:在公开手指基准上达到最高平均相关系数(在n=9受试者上差异不显著),在音频任务和低数据量患者校准中获得更大且统计显著的提升。特征分析符合神经生理学规律,潜在流形捕捉到低维手指运动结构。CORTEG系统性证明了头皮脑电预训练可复用于颅内脑电解码,支持数据高效的颅内脑机接口,可快速适应新患者。
原文摘要 · Abstract (English)
Intracranial electrocorticography (ECoG) offers high-signal-to-noise access to cortical activity for brain-computer interfaces, yet limited per-patient data has led most prior work to rely on small, subject-specific decoders that neglect information shared across patients. We investigate whether large pretrained scalp-EEG foundation models (EEG FMs) can be adapted to ECoG, enabling cross-patient learning and competitive decoding performance while calibrating to a held-out patient in 10-30 minutes on a single GPU. We introduce CORTEG, a cross-modality transfer framework that combines a pretrained EEG FM backbone, an electrode-aware KNNSoftFourier spatial adapter, a dual-stream tokenizer for low-frequency and high-gamma activity, and a leave-one-subject-out fine-tuning strategy. We evaluate CORTEG on two challenging regression tasks: public finger trajectory regression (n=9) and private audio envelope regression (n=16). CORTEG matches or exceeds the strongest task-specific baselines on both tasks: it reaches the highest mean correlation among compared methods on the public finger benchmark (gain not statistically significant on n=9 subjects), with larger and statistically significant gains on the audio task and in low-data per-patient calibration. Feature analyses align with neurophysiology, and latent manifolds capture low-dimensional finger-movement structure. CORTEG provides systematic evidence that scalp-EEG pretraining can be repurposed for ECoG decoding, enabling data-efficient intracranial BCIs that can adapt to new patients.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。