arXiv:2411.10458eess.SPcs.LG2024-11NeurIPS被引 19

跨个体脑电数据融合,实现精准行为解码

Neural decoding from stereotactic EEG: accounting for electrode variability across subjects

  • 用卷积与自注意力构建时空统一表征,处理电极位置和数量差异
  • 在21名受试者数据上训练,可仅凭脑电预测反应时间
  • 预训练表征支持少量新个体快速迁移,适合跨人脑机接口研究

基于深度学习的立体定向脑电图(sEEG)神经解码需扩大数据集与模型规模。然而,各受试者因临床需求导致电极数量与位置各异,缺乏对应关系,阻碍数据整合。本文提出seegnificant框架:通过卷积对电极内神经活动进行分词,利用时间维度自注意力捕捉长期依赖;再将电极3D位置融入词元,经电极维度自注意力提取有效时空表征;每个受试者使用独立头进行下游解码。在21名受试者执行行为任务的数据上训练多主体模型,结果表明仅凭神经数据即可解码每次试验的反应时间。此外,跨个体预训练的表征可在少样本条件下迁移到新受试者。本工作为大规模跨个体sEEG解码提供了可扩展的数据整合方案。

原文摘要 · Abstract (English)

Deep learning based neural decoding from stereotactic electroencephalography (sEEG) would likely benefit from scaling up both dataset and model size. To achieve this, combining data across multiple subjects is crucial. However, in sEEG cohorts, each subject has a variable number of electrodes placed at distinct locations in their brain, solely based on clinical needs. Such heterogeneity in electrode number/placement poses a significant challenge for data integration, since there is no clear correspondence of the neural activity recorded at distinct sites between individuals. Here we introduce seegnificant: a training framework and architecture that can be used to decode behavior across subjects using sEEG data. We tokenize the neural activity within electrodes using convolutions and extract long-term temporal dependencies between tokens using self-attention in the time dimension. The 3D location of each electrode is then mixed with the tokens, followed by another self-attention in the electrode dimension to extract effective spatiotemporal neural representations. Subject-specific heads are then used for downstream decoding tasks. Using this approach, we construct a multi-subject model trained on the combined data from 21 subjects performing a behavioral task. We demonstrate that our model is able to decode the trial-wise response time of the subjects during the behavioral task solely from neural data. We also show that the neural representations learned by pretraining our model across individuals can be transferred in a few-shot manner to new subjects. This work introduces a scalable approach towards sEEG data integration for multi-subject model training, paving the way for cross-subject generalization for sEEG decoding.

脑电解码跨个体自注意力迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。