arXiv:2605.28563cs.LGcs.AI2026-05

提出多维评估框架,真实测试脑电模型在低资源下的泛化能力。

A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models

论文配图:A Multi-dimensional Framework for Evaluating Generalization in EEG Foundation Models
图 1 · 摘自论文原文
  • 构建多维度评估框架,模拟真实医疗场景的资源限制。
  • 基础模型在长时序任务中表现更优,短窗口任务上与小模型相当。
  • 揭示现有模型对通道受限和短窗任务鲁棒性不足,适合临床研究者参考。

在合适的适配设置下评估基础模型,对于理解其学习表征的质量和可迁移性至关重要。近期脑电(EEG)基础模型在不同任务和数据集上展现出良好的迁移能力,推动其在神经科技与临床应用中的广泛应用。然而,这些模型通常在完整微调、标注数据充分的下游数据集上进行评估,这与生物医学领域的实际约束(如标注数据有限、传感器覆盖减少、参数高效适配)不符。本文提出一种多维度评估框架,用于在真实低资源条件下评估脑电模型。我们基于该框架,对6个不同数据集上的监督模型及最新脑电基础模型(包括LaBraM、CSBrain、CBraMod)进行了实证分析。结果表明,脑电基础模型在长时序任务(如睡眠分期预测、心理健康状态分类)中持续提供性能优势;而在短窗类脑机接口任务中,监督模型虽参数量显著更少,但性能相当。进一步分析显示,当前基础模型在短窗任务和通道受限设置下表现出有限的鲁棒性。这些发现强调了采用多维度评估协议的重要性,以刻画模型在现实使用约束下的行为表现。

原文摘要 · Abstract (English)

Evaluating foundation models under appropriate adaptation settings is essential for understanding the quality and transferability of the learned representations. Recent EEG foundation models have demonstrated promising transfer capabilities across tasks and datasets, motivating their growing use in neurotechnology and clinical applications. However, these models are typically evaluated under full fine-tuning on well-curated downstream datasets, a setting that does not reflect biomedical domain constraints such as limited labeled data, reduced sensor coverage, or parameter-efficient adaptation. In this work, we propose a multi-dimensional evaluation framework for assessing EEG models under realistic low-resource conditions. Empirical analysis of both supervised EEG models and recent EEG foundation models, including LaBraM, CSBrain, and CBraMod, across 6 different datasets is performed under the proposed multi-dimensional evaluation framework. We find that EEG foundation models consistently provide performance gains on long-context tasks such as sleep stage prediction and mental health state classification. In contrast, for short-window Brain Computer Interface style tasks, supervised models achieve comparable despite having substantially fewer parameters. Additional analyses demonstrate that current foundation models provide limited robustness to short-window tasks and channel constrained settings. Together, these findings motivate the use of multi-dimensional evaluation protocols that characterize model behavior under realistic use constraints.

脑电模型泛化评估低资源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。