arXiv:2412.07236eess.SPcs.AI2024-12ICLR被引 221

提出新型脑电基础模型CBraMod,提升解码精度与跨任务泛化能力。

CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding

论文配图:CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding
图 1 · 摘自论文原文
  • 采用十字交叉注意力机制,分别建模脑电信号时空特征。
  • 在12个公开数据集上实现10项脑机接口任务的领先性能。
  • 适配不同格式脑电数据,适合医疗与脑机接口研究者使用。

脑电图(EEG)是一种非侵入式记录大脑电活动的技术,广泛应用于脑机接口(BCI)和医疗领域。早期方法依赖有监督学习,受限于特定任务和数据集,影响模型性能与泛化性。随着大语言模型的成功,脑电基础模型研究兴起,但仍存在挑战:现有模型多采用全脑电建模策略,忽略脑电信号因结构特性导致的时空依赖异质性;且对多种格式脑电数据适应性差,限制了跨任务泛化。为此,本文提出新型基础模型CBraMod。设计十字交叉变压器作为主干网络,通过两条并行注意力机制分别建模空间与时间依赖关系。引入非对称条件位置编码方案,有效编码脑电片段位置信息,并可轻松适配不同格式数据。CBraMod在大规模脑电语料库上基于补丁掩码重建进行预训练。在最多10个下游脑机接口任务(共12个公共数据集)上评估,表现达到当前最优水平,验证其强大能力与泛化性。源代码已开源:https://github.com/wjq-learning/CBraMod。

原文摘要 · Abstract (English)

Electroencephalography (EEG) is a non-invasive technique to measure and record brain electrical activity, widely used in various BCI and healthcare applications. Early EEG decoding methods rely on supervised learning, limited by specific tasks and datasets, hindering model performance and generalizability. With the success of large language models, there is a growing body of studies focusing on EEG foundation models. However, these studies still leave challenges: Firstly, most of existing EEG foundation models employ full EEG modeling strategy. It models the spatial and temporal dependencies between all EEG patches together, but ignores that the spatial and temporal dependencies are heterogeneous due to the unique structural characteristics of EEG signals. Secondly, existing EEG foundation models have limited generalizability on a wide range of downstream BCI tasks due to varying formats of EEG data, making it challenging to adapt to. To address these challenges, we propose a novel foundation model called CBraMod. Specifically, we devise a criss-cross transformer as the backbone to thoroughly leverage the structural characteristics of EEG signals, which can model spatial and temporal dependencies separately through two parallel attention mechanisms. And we utilize an asymmetric conditional positional encoding scheme which can encode positional information of EEG patches and be easily adapted to the EEG with diverse formats. CBraMod is pre-trained on a very large corpus of EEG through patch-based masked EEG reconstruction. We evaluate CBraMod on up to 10 downstream BCI tasks (12 public datasets). CBraMod achieves the state-of-the-art performance across the wide range of tasks, proving its strong capability and generalizability. The source code is publicly available at https://github.com/wjq-learning/CBraMod.

脑电解码基础模型时空建模跨任务泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。