基于自适应时频注意力的脑电基础模型,提升信号解析能力
FoME: A Foundation Model for EEG using Adaptive Temporal-Lateral Attention Scaling
- 引入自适应时-侧注意力机制,融合时间与频域特征
- 在1.7TB数据上预训练,参数量达7.45亿,覆盖多类型脑电信号
- 适用于脑机接口、临床诊断等场景,推动神经科学研究
脑电图(EEG)是神经科学与临床应用中测量和记录大脑活动的重要工具,但其潜力受限于信号异质性、信噪比低以及标注数据有限。本文提出FoME(EEG基础模型),采用自适应时-侧注意力缩放机制以应对上述挑战。FoME在包含74500万参数、总计1.7TB的头皮及皮层脑电记录数据集上进行预训练,训练步数达1,096,000步。模型创新性地结合了时频融合嵌入技术与自适应时间-侧注意力缩放(ATLAS)机制,协同捕捉复杂的时空与频谱动态,实现对多样化数据流的自适应建模,支持鲁棒的多通道分析。在四项下游任务中,FoME在分类与预测任务中均达到当前最优性能。本研究为脑电分析建立新范式,为脑机接口、临床诊断与认知研究提供通用基础工具。代码将公开于https://github.com/1061413241/FoME。
原文摘要 · Abstract (English)
Electroencephalography (EEG) is a vital tool to measure and record brain activity in neuroscience and clinical applications, yet its potential is constrained by signal heterogeneity, low signal-to-noise ratios, and limited labeled datasets. In this paper, we propose FoME (Foundation Model for EEG), a novel approach using adaptive temporal-lateral attention scaling to address above-mentioned challenges. FoME is pre-trained on a diverse 1.7TB dataset of scalp and intracranial EEG recordings, comprising 745M parameters trained for 1,096k steps. Our model introduces two key innovations: a time-frequency fusion embedding technique and an adaptive time-lateral attention scaling (ATLAS) mechanism. These components synergistically capture complex temporal and spectral EEG dynamics, enabling FoME to adapt to varying patterns across diverse data streams and facilitate robust multi-channel modeling. Evaluations across four downstream tasks demonstrate FoME's superior performance in classification and forecasting applications, consistently achieving state-of-the-art results. To conclude, FoME establishes a new paradigm for EEG analysis, offering a versatile foundation that advances brain-computer interfaces, clinical diagnostics, and cognitive research across neuroscience and related fields. Our code will be available at https://github.com/1061413241/FoME.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。