首次系统评估脑电基础模型的鲁棒性、可解释性与表达能力。
Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models

- 通过多层分析,检验模型在噪声、通道缺失等干扰下的表现。
- 发现不同模型对各类扰动的脆弱性各异,且注意力集中于符合神经生理的脑区。
- 揭示模型表达能力被低估,保留令牌嵌入可显著提升性能。
脑电基础模型(EEG-FMs)的评估长期聚焦于干净数据上的准确率,对其鲁棒性、可解释性和表征质量研究不足。本研究在八个数据集上对比六种EEG-FMs与基线深度学习模型,开展三层次分析:(i) 鲁棒性:施加添加噪声、随机及区域通道丢弃、区域噪声注入等测试时扰动,发现无模型在所有失效模式中占优;最抗噪模型在通道丢弃下反而最脆弱,而通道移除比零填充更能缓解此脆弱性。(ii) 可解释性:首次将注意力感知层间相关性传播(AttnLRP)应用于EEG-FMs,显示模型普遍关注任务相关的脑区,符合已知神经生理学规律;但归因图在扰动下保持空间稳定,预测却下降,表明模型关注正确区域但解码了受损内容。(iii) 表达力:通过分块探测发现,微调时晚期块被重用,早期块已包含任务相关信息;此前认为头区性能差源于预训练表示质量低,实则主要由池化机制导致,若保留令牌级嵌入,EEG-FMs具备充分表征能力。这些发现为EEG-FMs的开发提供了关键指导。
原文摘要 · Abstract (English)
EEG foundation models (EEG-FMs) have been evaluated predominantly on clean, in-distribution accuracy, leaving their robustness, interpretability and representational quality largely unexamined. This study addresses these gaps by benchmarking six EEG-FMs against a baseline deep learning model across eight datasets. Beyond clean accuracy, we conduct three layers of analysis: (i) Robustness: we apply test-time perturbations including additive noise, random and region-based channel dropout and region-specific noise injection. Our analyses show that no single model dominates all failure modes. The most noise-robust model is among the most fragile under channel dropout and much of the dropout fragility disappears when channels are removed rather than zero-padded. (ii) Interpretability: we present the first application of Attention-Aware Layer-Wise Relevance Propagation (AttnLRP) to EEG-FMs and show that models broadly concentrate relevance on task-appropriate brain regions consistent with known neurophysiology. However, attribution maps remain spatially stable under perturbation while predictions degrade, suggesting that the models attend to the correct brain regions but decode corrupted content. (iii) Expressiveness: With block-wise probing we show that late blocks are repurposed during fine-tuning, while early blocks already hold task-related information. Furthermore, we demonstrate that the poor head-only performance previously attributed to low-quality pre-trained representations is largely explained by pooling and that EEG-FMs possess sufficient representational capacity when their token-level embeddings are preserved. Together, these findings provide the first systematic assessment of robustness, interpretability and expressiveness for EEG-FMs and highlight critical considerations for their development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。