arXiv:2510.21585cs.LGq-bio.NC2025-10NeurIPS被引 73

REVE模型通过大规模预训练实现跨不同脑电采集设备的通用建模。

REVE: A Foundation Model for EEG -- Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects

  • 设计4D位置编码,支持任意长度和电极布局的脑电信号输入
  • 在25,000人、60,000小时数据上预训练,覆盖92个数据集
  • 无需微调即可在10项任务中达到领先性能,适合临床与科研应用

基础模型通过大规模预训练减少了对特定任务数据的依赖。尽管在语言和视觉领域取得成功,脑电(EEG)领域的应用却因公开数据集的异质性而滞后——这些数据来自不同的采集协议、设备和电极配置。现有EEG基础模型难以跨这些差异泛化,通常仅在单一设置下预训练,导致线性探测等任务性能不佳。本文提出REVE(带通用嵌入的脑电表示),一种专为跨多种脑电信号泛化而设计的预训练模型。REVE引入新型4D位置编码,可处理任意长度和电极排列的信号。我们使用掩码自编码目标,在涵盖92个数据集、25,000名受试者、超过60,000小时的脑电数据上预训练了REVE,这是迄今规模最大的EEG预训练工作。REVE在10项下游任务中均达到最新水平,包括运动想象分类、癫痫发作检测、睡眠分期、认知负荷估计和情绪识别。在极少或无需微调的情况下,展现出强大的泛化能力和精细的时空建模能力。我们开源代码、预训练权重及教程,以推动标准化脑电研究,加速临床神经科学进展。

原文摘要 · Abstract (English)

Foundation models have transformed AI by reducing reliance on task-specific data through large-scale pretraining. While successful in language and vision, their adoption in EEG has lagged due to the heterogeneity of public datasets, which are collected under varying protocols, devices, and electrode configurations. Existing EEG foundation models struggle to generalize across these variations, often restricting pretraining to a single setup, resulting in suboptimal performance, in particular under linear probing. We present REVE (Representation for EEG with Versatile Embeddings), a pretrained model explicitly designed to generalize across diverse EEG signals. REVE introduces a novel 4D positional encoding scheme that enables it to process signals of arbitrary length and electrode arrangement. Using a masked autoencoding objective, we pretrain REVE on over 60,000 hours of EEG data from 92 datasets spanning 25,000 subjects, representing the largest EEG pretraining effort to date. REVE achieves state-of-the-art results on 10 downstream EEG tasks, including motor imagery classification, seizure detection, sleep staging, cognitive load estimation, and emotion recognition. With little to no fine-tuning, it demonstrates strong generalization, and nuanced spatio-temporal modeling. We release code, pretrained weights, and tutorials to support standardized EEG research and accelerate progress in clinical neuroscience.

脑电模型预训练通用建模临床神经科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。