arXiv:2605.26910cs.LGcs.AI2026-05被引 2

为脑电基础模型设计可解释评估流程,揭示其真实效能

EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Models

论文配图:EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Models
图 1 · 摘自论文原文
  • 用自动化调优确保基线公平比较,避免结果偏差
  • 发现调优后的传统模型性能可超越复杂基础模型
  • 通过神经生理探针验证模型是否利用真实脑电信号特征

大型脑电基础模型(EEG-FMs)在多种认知任务中展现出解码脑电信号的潜力。然而现有研究存在三大局限:监督基线调优不透明、复杂学习范式贡献未验证、模型决策过程缺乏透明度。为此,我们提出 EEG-FM-Audit,一个系统化的评估与分析流程,包含三个核心组件:(1) 基于 ASHA 的基准测试协议,透明优化监督基线以实现公平比较;(2) 范式级消融实验,评估学习范式在基础模型中的有效性;(3) 神经生理探针(NPP)框架,检验基础模型是否利用了真实的时空谱脑电特性。我们在三个公开数据集上对四个先进 EEG-FMs 和五个代表性监督模型进行了测试。结果表明,经过合理调优的监督基线模型性能可媲美甚至超过先进基础模型,且参数量显著更少。学习范式的有效性高度依赖数据规模和模型架构。NPP 分析揭示了基础模型如何依赖特定生理特征,为更可解释的神经解码提供了新框架。

原文摘要 · Abstract (English)

Large EEG Foundation Models (FMs) have shown great potential for decoding EEG signals across diverse cognitive tasks. However, existing EEG-FM studies exhibit three critical limitations: opaque supervised baseline tuning, unverified contributions of complex learning paradigms, and a lack of transparency in model decision-making. To address these, we propose EEG-FM-Audit, a comprehensive evaluation and analysis pipeline designed to systematize the assessment of EEG-FMs. EEG-FM-Audit consists of three primary components: (1) an ASHA-driven benchmarking protocol that ensures fair comparisons by transparently optimizing supervised baselines; (2) paradigm-level ablation studies to evaluate the effectiveness of learning paradigms in FMs; and (3) a neurophysiological probing (NPP) framework, which explores whether FMs leverage valid temporal, spatial, and spectral EEG properties. We apply EEG-FM-Audit to four state-of-the-art EEG-FMs and five representative supervised models across three public datasets. Our results reveal that properly tuned supervised baselines can match or outperform advanced FMs, despite requiring significantly fewer parameters. Furthermore, we find that the effectiveness of learning paradigms of FMs is highly dependent on dataset scale and architecture. Finally, NPP analysis demonstrates how FMs rely on specific physiological features, establishing a framework for more interpretable neural decoding.

脑电分析模型评估可解释性基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。