提出首个脑电基础模型,实现跨被试、跨任务的通用分析能力。
Large Cognition Model: Towards Pretrained EEG Foundation Model
- 基于时频注意力机制的Transformer架构,无需预训练即具强泛化性。
- 在多个脑电基准上超越现有模型,跨被试准确率提升显著。
- 适合神经科学、脑机接口与临床诊断领域研究者使用。
脑电图(EEG)为神经科学研究、脑机接口和临床诊断提供了非侵入性视角,但其发展受限于大规模标注数据稀缺及信号个体间差异。受自然语言处理与计算机视觉中基础模型成功的启发,我们提出大型认知模型(Large Cognition Model, LCM)——一种基于Transformer的通用脑电基础模型,可跨数据集与下游任务泛化。不同于传统方法,该模型在未预训练情况下仍展现出强大泛化能力,在部分下游任务上优于现有通用脑电模型。LCM采用大规模自监督学习,捕捉通用脑电表征,支持认知状态解码、疾病分类与神经反馈系统等应用的高效微调。新架构融合时序与频谱注意力机制,优化原始信号特征提取能力。大量实验证明,LCM在多个脑电基准上表现领先,具备出色的跨被试与跨任务泛化能力。研究结果表明,预训练脑电基础模型有望加速神经科学、个性化医疗与脑机接口技术的发展。
原文摘要 · Abstract (English)
Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models for EEG analysis is hindered by the scarcity of large-scale, well-annotated datasets and the inherent variability of EEG signals across subjects and recording conditions. Inspired by the success of foundation models in natural language processing and computer vision, we propose the Large Cognition Model-a transformer-based foundation model designed to generalize across diverse EEG datasets and downstream tasks. Unlike traditional approaches, our proposed transformer-based architecture demonstrates strong generalization capabilities across datasets and tasks, even without pretraining, surpassing some existing EEG universal models on specific downstream applications. LCM leverages large-scale self-supervised learning techniques to capture universal EEG representations, enabling efficient fine-tuning for applications such as cognitive state decoding, disease classification, and neurofeedback systems. We introduce a novel architecture that integrates temporal and spectral attention mechanisms, optimizing the model's ability to extract meaningful features from raw EEG signals. Extensive evaluations demonstrate that LCM outperforms state-of-the-art approaches across multiple EEG benchmarks, exhibiting strong cross-subject and cross-task generalization. Our findings highlight the potential of pretrained EEG foundation models to accelerate advancements in neuroscience, personalized medicine, and BCI technology.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。