构建首个通用脑机接口基准,评估大模型在真实场景中的泛化能力。
AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applications
- 设计标准化流程,适配多种脑信号任务
- 覆盖7类关键应用,支持跨被试/少样本等测试场景
- 开源工具链,助力可复现研究与模型选型
非侵入式脑机接口(BCI)为连接人脑与外部设备提供了安全、便捷的途径,广泛应用于家庭和临床场景以增强人类能力。然而,非侵入信号噪声高、特定任务数据有限,制约了解码性能。近期自监督预训练推动了脑基础模型的发展,使其能从大规模带噪脑电(EEG)数据中学习通用神经表征。但当前领域缺乏全面、实用且可扩展的基准来评估公共基础模型在多样BCI任务中的表现,阻碍其广泛应用。为此,我们提出AdaBrain-Bench——一个大规模标准化基准,系统评估脑基础模型在典型非侵入式BCI任务中的表现。该基准涵盖7个关键应用的代表性解码数据集,引入简化的任务适配流程,集成多维评估指标与一套适配工具。它提供了一个包容性框架,用于评估模型在跨被试、多被试及少样本等关键迁移设置下的泛化能力。我们利用该基准评估了一系列公开可用的脑基础模型,并为不同场景下的模型选择提供实践洞见。我们开源基准流程,支持可复现研究与外部使用,打造持续演进的平台,推动鲁棒、通用神经解码解决方案的发展。
原文摘要 · Abstract (English)
Non-invasive Brain-Computer Interfaces (BCI) offer a safe and accessible means of connecting the human brain to external devices, with broad applications in home and clinical settings to enhance human capabilities. However, the high noise level and limited task-specific data in non-invasive signals constrain decoding capabilities. Recently, the adoption of self-supervised pre-training is transforming the landscape of non-invasive BCI research, enabling the development of brain foundation models to capture generic neural representations from large-scale unlabeled electroencephalography (EEG) signals with substantial noises. However, despite these advances, the field currently lacks comprehensive, practical and extensible benchmarks to assess the utility of the public foundation models across diverse BCI tasks, hindering their widespread adoption. To address this challenge, we present AdaBrain-Bench, a large-scale standardized benchmark to systematically evaluate brain foundation models in widespread non-invasive BCI tasks. AdaBrain-Bench encompasses a diverse collection of representative BCI decoding datasets spanning 7 key applications. It introduces a streamlined task adaptation pipeline integrated with multi-dimensional evaluation metrics and a set of adaptation tools. The benchmark delivers an inclusive framework for assessing generalizability of brain foundation models across key transfer settings, including cross-subject, multi-subject, and few-shot scenarios. We leverage AdaBrain-Bench to evaluate a suite of publicly available brain foundation models and offer insights into practices for selecting appropriate models in various scenarios. We make our benchmark pipeline available to enable reproducible research and external use, offering a continuously evolving platform to foster progress toward robust and generalized neural decoding solutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。