arXiv:2510.16548cs.LG2025-10NeurIPS被引 11

NeurIPT是首个针对多场景脑电的通用模型,提升脑机接口解码性能。

NeurIPT: Foundation Model for Neural Interfaces

  • 用基于振幅的掩码预训练+专家混合架构,捕捉脑电信号时空特征。
  • 在8个脑机接口数据集上达到领先效果,跨被试、任务泛化能力强。
  • 适合脑机接口、神经工程领域研究者,推动可迁移脑信号建模发展。

脑电图(EEG)在临床诊断与脑机接口(BCIs)中应用广泛。随着脑电数据量和多样性增加,建立基础模型(FMs)以实现神经解码的规模化与泛化成为研究热点。然而,由于个体间、任务间及条件间的显著差异,以及不同设备的电极配置差异,将基础模型应用于脑电仍具挑战。为此,我们提出NeurIPT,一种面向多样化脑电神经接口的基础模型,采用预训练的Transformer架构,捕捉脑电信号中固有的同质与异质时空特性。时间上,引入振幅感知掩码预训练(AAMP),根据信号振幅而非随机区间进行掩码,学习在不同信号强度下的鲁棒表示,超越局部插值;并通过渐进式专家混合(PMoE)架构,在深层逐步引入专用专家子网络,有效适应脑电信号的时间多样性。空间上,利用电极的三维物理坐标,实现嵌入在不同脑电设置间的有效迁移,并在微调阶段引入脑叶内-间池化(IILP),高效利用区域脑特征。在八个下游脑机接口数据集上的实证评估表明,通过微调,NeurIPT持续取得最佳性能,凸显其广泛适用性与强泛化能力。本工作推进了脑电基础模型的发展,为可扩展、通用的神经信息处理系统提供新思路。

原文摘要 · Abstract (English)

Electroencephalography (EEG) has wide-ranging applications, from clinical diagnosis to brain-computer interfaces (BCIs). With the increasing volume and variety of EEG data, there has been growing interest in establishing foundation models (FMs) to scale up and generalize neural decoding. Despite showing early potential, applying FMs to EEG remains challenging due to substantial inter-subject, inter-task, and inter-condition variability, as well as diverse electrode configurations across recording setups. To tackle these open challenges, we propose NeurIPT, a foundation model developed for diverse EEG-based Neural Interfaces with a Pre-trained Transformer by capturing both homogeneous and heterogeneous spatio-temporal characteristics inherent in EEG signals. Temporally, we introduce Amplitude-Aware Masked Pretraining (AAMP), masking based on signal amplitude rather than random intervals, to learn robust representations across varying signal intensities beyond local interpolation. Moreover, this temporal representation is enhanced by a Progressive Mixture-of-Experts (PMoE) architecture, where specialized expert subnetworks are progressively introduced at deeper layers, adapting effectively to the diverse temporal characteristics of EEG signals. Spatially, NeurIPT leverages the 3D physical coordinates of electrodes, enabling effective transfer of embedding across varying EEG settings, and develops Intra-Inter Lobe Pooling (IILP) during fine-tuning to efficiently exploit regional brain features. Empirical evaluations across eight downstream BCI datasets, via fine-tuning, demonstrated NeurIPT consistently achieved state-of-the-art performance, highlighting its broad applicability and robust generalization. Our work pushes forward the state of FMs in EEG and offers insights into scalable and generalizable neural information processing systems.

脑机接口基础模型脑电信号Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。