提出DLGE模型,实现无需重训练的跨脑机接口范式通用解码。
DLGE: Dual Local-Global Encoding for Generalizable Cross-BCI-Paradigm
- 通过局部-全局双编码结构,融合时频特征与空间注意力,学习跨范式共享特征。
- 在3种不同脑机范式上达到平均60%以上的精准率、召回率和F1分数。
- 适用于便携式设备,为通用脑机接口解码提供简单高效的新方案。
深度学习模型常用于基于脑电图(EEG)的单个脑机接口(BCI)范式解码。由于通道配置差异和任务相关表示不一致,统一模型解码多个范式极具挑战。本文提出双局部-全局编码器(DLGE),实现跨范式的分类。针对不同范式间EEG通道配置异质性,采用解剖学启发的脑区分区与填充策略标准化通道配置。局部编码器在各脑区内基于时频信息学习跨范式共享特征,结合通道内时间注意力与脑区间空间注意力;这些共享特征随后在全局编码器中聚合,形成各自范式特异性特征表示。在三种范式(运动想象、静息态、驾驶疲劳)上的实验表明,该模型无需重新训练或调参即可处理多种范式,平均宏精度、召回率和F1分数分别为60.16%、59.88%和59.56%。本研究首次尝试构建跨范式通用解码模型,避免对每种范式重复开发,为便携式设备实现通用脑机解码提供了有效且简洁的路径。
原文摘要 · Abstract (English)
Deep learning models have been frequently used to decode a single brain-computer interface (BCI) paradigm based on electroencephalography (EEG). It is challenging to decode multiple BCI paradigms using one model due to diverse barriers, such as different channel configurations and disparate task-related representations. In this study, we propose Dual Local-Global Encoder (DLGE), enabling the classification across different BCI paradigms. To address the heterogeneity in EEG channel configurations across paradigms, we employ an anatomically inspired brain-region partitioning and padding strategy to standardize EEG channel configuration. In the proposed model, the local encoder is designed to learn shared features across BCI paradigms within each brain region based on time-frequency information, which integrates temporal attention on individual channels with spatial attention among channels for each brain region. These shared features are subsequently aggregated in the global encoder to form respective paradigm-specific feature representations. Three BCI paradigms (motor imagery, resting state, and driving fatigue) were used to evaluate the proposed model. The results demonstrate that our model is capable of processing diverse BCI paradigms without retraining and retuning, achieving average macro precision, recall, and F1-score of 60.16\%, 59.88\%, and 59.56\%, respectively. We made an initial attempt to develop a general model for cross-BCI-paradigm classification, avoiding retraining or redevelopment for each paradigm. This study paves the way for the development of an effective but simple model for cross-BCI-paradigm decoding, which might benefit the design of portable devices for universal BCI decoding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。