arXiv:2606.00815cs.LG2026-06被引 4

构建首个统一的脑电基础模型评估基准,推动脑机接口研究标准化。

OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models

论文配图:OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models
图 1 · 摘自论文原文
  • 设计六类任务体系,统一54个数据集的评估流程与指标规范。
  • 10个模型实测显示,预训练数据多样性与模型规模显著影响性能表现。
  • 适合脑电、脑机接口及大模型研究者使用,助力技术落地。

脑电图(EEG)支持从脑状态监测到人-大语言模型交互等多种脑机接口任务。尽管脑电基础模型逐渐兴起,但评估仍因数据集异质性和任务协议不一致而分散。本文提出OmniEEG-Bench,一个统一的脑电基础模型评估基准与下游任务路线图。该基准涵盖六大任务类别:(i) 信号可靠性,(ii) 生物特征与疾病,(iii) 意识与状态,(iv) 认知与情绪,(v) 自然刺激解码,(vi) 运动与交互,并引入此前未系统评估的新一代任务。通过任务卡规范,统一模型部署、任务定义与评估指标,整合54个脑电数据集并采用一致协议。我们对10个代表性脑电基础模型进行评测,发布跨多种设置的排行榜。结果显示,预训练数据多样性和模型规模与平均排名显著相关,揭示脑电基础模型存在缩放规律(图1)。这表明提升模型性能不仅需更大架构,还需更广泛多样的预训练数据。基准代码已开源:https://github.com/ncclab-sustech/omni-eegbench.git。

原文摘要 · Abstract (English)

Electroencephalography (EEG) supports a variety of brain-computer interface (BCI) tasks ranging from brain-state monitoring to human-LLM interactions. EEG foundation models are emerging, but evaluation remains fragmented due to heterogeneous datasets and nconsistent task protocols. Here, we introduce OmniEEG-Bench, a unified benchmark and downstream task roadmap for EEG foundation models (FMs). It organizes evaluation of EEG FMs into six task families spanning (i) signal reliability, (ii) biometrics and disease, (iii) consciousness and state, (iv) cognition and emotion, (v) naturalistic stimulus decoding, and (vi) motor and interaction, introducing a new generation of tasks not systematically benchmarked in prior EEG FM work. OmniEEG-Bench standardizes model deployment, task definitions, and metrics through a task-card specification, and unifies 54 EEG datasets with consistent evaluation protocols. We benchmark 10 representative EEG foundation models and report a leaderboard that covers diverse evaluation settings. Both pretraining dataset diversity and model size are significantly associated with better average ranks across datasets, revealing scaling-law behavior in EEG foundation models (Figure 1). These results suggest that scaling EEG foundation models requires not only larger architectures but also broader and more diverse pretraining data. The benchmark code is available at https://github.com/ncclab-sustech/omni-eegbench.git.

脑电分析基础模型评估基准脑机接口

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。