arXiv:2410.19779eess.SPcs.LG2024-10被引 6

首个通用脑电基础模型,实现多任务跨设备高精度脑电分析

BrainGPT: Unleashing the Potential of EEG Generalist Foundation Model by Autoregressive Pre-training

  • 采用电极独立建模与自回归预训练,更好捕捉脑电信号时序特征
  • 支持最多138电极输入,在12个基准上5项任务超越现有专用模型
  • 首个验证多任务协同的脑电通用模型,适合神经科学、临床诊断等场景

脑电图(EEG)信号对揭示自发脑活动至关重要,但通用脑电模型受限于数据格式多样、预训练范式陈旧及迁移学习方法有限,仅能构建单一数据集专用模型。本文提出EEGPT,首个通用脑电基础模型。首先,采用电极级建模策略,将每个电极视为基本单元,整合来自最多138个电极的数据,共3750万条预训练样本。其次,开发首个自回归预训练脑电模型,摒弃传统掩码自编码器,改用下一时刻信号预测任务,更有效建模时序依赖性;并探索高达11亿参数的缩放规律,为脑电研究中最大模型。第三,引入共享可学习电极图网络的多任务迁移学习范式,首次证实多任务兼容性与协同效应。EEGPT具备广泛适配性,支持任意数量和组合的电极输入,可在5个不同任务的12个基准上评估。其性能全面超越现有专用模型,经大量消融实验验证有效性。该工作为通用脑电建模开辟新方向,提升可扩展性、迁移性和适应性。代码与模型将公开。

原文摘要 · Abstract (English)

Electroencephalogram (EEG) signals are pivotal in providing insights into spontaneous brain activity, highlighting their significant importance in neuroscience research. However, the exploration of versatile EEG models is constrained by diverse data formats, outdated pre-training paradigms, and limited transfer learning methods, only leading to specialist models on single dataset. In this paper, we introduce EEGPT, the first generalist EEG foundation model designed to address these challenges. First, we propose an electrode-wise modeling strategy that treats each electrode as a fundamental unit, enabling the integration of diverse EEG datasets collected from up to 138 electrodes, amassing 37.5M pre-training samples. Second, we develop the first autoregressive EEG pre-trained model, moving away from traditional masked autoencoder approaches to a next signal prediction task that better captures the sequential and temporal dependencies of EEG data. We also explore scaling laws with model up to 1.1B parameters: the largest in EEG research to date. Third, we introduce a multi-task transfer learning paradigm using a learnable electrode graph network shared across tasks, which for the first time confirms multi-task compatibility and synergy. As the first generalist EEG foundation model, EEGPT shows broad compatibility with various signal acquisition devices, subjects, and tasks. It supports up to 138 electrodes and any combination thereof as input. Furthermore, we simultaneously evaluate it on 5 distinct tasks across 12 benchmarks. EEGPT consistently outperforms existing specialist models across all downstream tasks, with its effectiveness further validated through extensive ablation studies. This work sets a new direction for generalist EEG modeling, offering improved scalability, transferability, and adaptability for a wide range of EEG applications. The code and models will be released.

脑电图基础模型自回归多任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。