构建可跨设备、抗噪声的脑电基础模型,提升不同场景下脑电信号分析性能
EEG-X: Device-Agnostic and Noise-Robust Foundation Model for EEG
- 通过位置编码通道嵌入,适应不同电极数量和布局
- 在去噪后的信号上进行掩码重建,学习更纯净的神经活动表征
- 适合需要跨设备迁移的脑电研究者使用
脑电图(EEG)分析的基础模型仍处于起步阶段,主要受限于两个关键问题:(1) 不同记录设备和配置导致的数据集间差异;(2) 脑电信号信噪比低,常被伪迹和非脑源信号掩盖。为此,我们提出 EEG-X,一种设备无关且抗噪声的脑电基础模型,用于表征学习。EEG-X 引入基于位置的通道嵌入,编码空间信息,提升跨领域与任务的泛化能力,可处理不同电极数、组合及记录长度。为增强抗噪性,该模型在原始与潜在空间均采用噪声感知的掩码与重建策略。不同于以往在原始噪声信号上训练的方法,EEG-X 以去伪迹后信号为重建目标,确保表征聚焦于神经活动而非噪声。为进一步提升基于重建的预训练效果,引入受字典启发的卷积变换(DiCT)层,在计算重建损失(均方误差)前将信号投影至结构化特征空间,降低对噪声的敏感性,并捕捉频率与波形相关的相似性。在来自多种设备的数据集上的实验表明,EEG-X 在多个下游脑电任务中优于现有最佳方法,尤其在预训练与下游数据集电极布局不同的跨域场景中表现突出。模型与代码已开源:https://github.com/Emotiv/EEG-X
原文摘要 · Abstract (English)
Foundation models for EEG analysis are still in their infancy, limited by two key challenges: (1) variability across datasets caused by differences in recording devices and configurations, and (2) the low signal-to-noise ratio (SNR) of EEG, where brain signals are often buried under artifacts and non-brain sources. To address these challenges, we present EEG-X, a device-agnostic and noise-robust foundation model for EEG representation learning. EEG-X introduces a novel location-based channel embedding that encodes spatial information and improves generalization across domains and tasks by allowing the model to handle varying channel numbers, combinations, and recording lengths. To enhance robustness against noise, EEG-X employs a noise-aware masking and reconstruction strategy in both raw and latent spaces. Unlike previous models that mask and reconstruct raw noisy EEG signals, EEG-X is trained to reconstruct denoised signals obtained through an artifact removal process, ensuring that the learned representations focus on neural activity rather than noise. To further enhance reconstruction-based pretraining, EEG-X introduces a dictionary-inspired convolutional transformation (DiCT) layer that projects signals into a structured feature space before computing reconstruction (MSE) loss, reducing noise sensitivity and capturing frequency- and shape-aware similarities. Experiments on datasets collected from diverse devices show that EEG-X outperforms state-of-the-art methods across multiple downstream EEG tasks and excels in cross-domain settings where pre-trained and downstream datasets differ in electrode layouts. The models and code are available at: https://github.com/Emotiv/EEG-X
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。