arXiv:2506.20354cs.LGcs.AI2025-06被引 1

提出新型注意力机制,让模型能通用处理不同脑电通道配置。

A foundation model with multi-variate parallel attention to generate neuronal activity

  • 分离内容、时间、空间注意力,灵活建模多通道脑电信号
  • 在多个脑电数据集上实现专家级癫痫检测与语音解码性能
  • 首个开源开放的脑电基础模型,支持科研复现与临床应用

深度神经网络在异构通道配置的多变量时间序列学习中仍面临根本挑战,尤其在颅内脑电(iEEG)等临床领域,各受试者通道设置差异大。本文提出多变量并行注意力(MVPA),一种新型自注意力机制,解耦内容、时间与空间注意力,实现对通道数和配置各异的时间序列的灵活、可泛化且高效的建模。基于此构建MVPFormer,一个用于人类脑电生理的生成式基础模型,训练目标为预测跨受试者的iEEG信号演化。为支持社区研究,我们发布目前最大公开iEEG数据集SWEC,包含近10,000小时来自异构临床源的记录。MVPFormer利用MVPA在跨受试者任务中展现强泛化能力,在SWEC、MAYO和FNUSA数据集上超越现有SOTA Transformer基线,在四个Brain TreeBank iEEG解码任务(体积、音高、起始点、言语)中也达到SOTA水平。我们在标准时间序列预测与分类任务中进一步验证了MVPA,其表现匹配或优于现有注意力模型。本工作确立了MVPA作为异构时间序列的通用注意力机制,MVPFormer则成为首个开源、开权重、开数据的iEEG基础模型,具备临床级性能。代码已公开于https://github.com/IBM/multi-variate-parallel-transformer,SWEC数据集可在https://huggingface.co/datasets/NeuroTec/SWEC_iEEG_Dataset获取。

原文摘要 · Abstract (English)

Learning from multi-variate time-series with heterogeneous channel configurations remains a fundamental challenge for deep neural networks, particularly in clinical domains such as intracranial electroencephalography (iEEG), where channel setups vary widely across subjects. In this work, we introduce multi-variate parallel attention (MVPA), a novel self-attention mechanism that disentangles content, temporal, and spatial attention, enabling flexible, generalizable, and efficient modeling of time-series data with varying channel counts and configurations. We use MVPA to build MVPFormer, a generative foundation model for human electrophysiology, trained to predict the evolution of iEEG signals across subjects. To support this and future efforts by the community, we release the SWEC iEEG dataset, the largest publicly available iEEG dataset to date, comprising nearly 10,000 hours of recordings from heterogeneous clinical sources. MVPFormer leverages MVPA to achieve strong generalization across subjects, demonstrating expert-level performance in several iEEG tasks. MVPFormer surpasses state-of-the-art (SOTA) Transformer baselines in seizure detection across the SWEC, the MAYO, and the FNUSA datasets, while also achieving SOTA performance on four Brain TreeBank iEEG decoding tasks (volume, pitch, onset, and speech). We further validate MVPA on standard time-series forecasting and classification tasks, where it matches or exceeds the performance of existing attention-based models. Together, our contributions establish MVPA as a general-purpose attention mechanism for heterogeneous time-series and MVPFormer as the first open-source, open-weights, and open-data iEEG foundation model with SOTA clinical performance. The code is available at https://github.com/IBM/multi-variate-parallel-transformer. The SWEC iEEG dataset is available at https://huggingface.co/datasets/NeuroTec/SWEC_iEEG_Dataset.

脑电建模注意力机制生成模型多变量时序

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。