用Transformer构建脑磁图基础模型,能生成真实脑活动数据并提升解码准确率。
MEG-GPT: A transformer-based foundation model for magnetoencephalography data
- 设计时间注意力机制与下一步预测任务,结合新型数据驱动分词器处理连续脑磁图信号。
- 在612人数据上训练,零样本跨会话/跨被试解码准确率分别提升至0.59和0.49。
- 可高效微调小标注数据,适合神经解码与计算神经科学应用。
建模大规模脑活动的复杂时空模式对神经科学至关重要,但传统方法难以捕捉脑磁图(MEG)等模态的丰富结构。我们提出MEG-GPT,一种基于Transformer的基础模型,采用时间注意力与下一步时间点预测策略。为此,我们引入一种新型数据驱动分词器,能在不丢失高时间分辨率的前提下对连续MEG数据进行编码。模型在大规模MEG数据集(N=612,闭眼静息状态,Cam-CAN数据)上训练,学习到的模型可生成具有真实时空谱特性的数据,包括瞬时事件与群体差异。关键的是,其在下游解码任务中表现优异,相比基线方法,零样本跨会话解码准确率从0.54提升至0.59,跨被试准确率从0.41提升至0.49。此外,模型可在小规模标注数据上高效微调,显著提升跨被试解码性能。该工作为电生理数据建立了一个强大基础模型,为计算神经科学与神经解码应用铺平道路。
原文摘要 · Abstract (English)
Modelling the complex spatiotemporal patterns of large-scale brain dynamics is crucial for neuroscience, but traditional methods fail to capture the rich structure in modalities such as magnetoencephalography (MEG). Recent advances in deep learning have enabled significant progress in other domains, such as language and vision, by using foundation models at scale. Here, we introduce MEG-GPT, a transformer based foundation model that uses time-attention and next time-point prediction. To facilitate this, we also introduce a novel data-driven tokeniser for continuous MEG data, which preserves the high temporal resolution of continuous MEG signals without lossy transformations. We trained MEG-GPT on tokenised brain region time-courses extracted from a large-scale MEG dataset (N=612, eyes-closed rest, Cam-CAN data), and show that the learnt model can generate data with realistic spatio-spectral properties, including transient events and population variability. Critically, it performs well in downstream decoding tasks, improving downstream supervised prediction task, showing improved zero-shot generalisation across sessions (improving accuracy from 0.54 to 0.59) and subjects (improving accuracy from 0.41 to 0.49) compared to a baseline methods. Furthermore, we show the model can be efficiently fine-tuned on a smaller labelled dataset to boost performance in cross-subject decoding scenarios. This work establishes a powerful foundation model for electrophysiological data, paving the way for applications in computational neuroscience and neural decoding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。