大脑波模型效率低,微调发现参数多但提升小。
Are Large Brainwave Foundation Models Capable Yet? Insights from Fine-tuning

- 用微调和低秩适配评估主流大脑波大模型
- 性能仅提升0.9%-1.2%,但参数量大数百倍
- 首次将LoRA用于大脑波模型,多组件联合适配更有效
基础模型在人工智能多个领域取得显著成功,但在脑电建模方面的能力仍不明确。本文通过系统性微调实验,在多个脑机接口(BCI)基准任务(包括记忆任务和睡眠阶段分类)上全面评估当前大型脑电基础模型(LBMs)。结果表明,最先进模型相比传统深度架构仅实现0.9%-1.2%的边际提升,却需数百万参数(远超数千级传统模型),引发其在BCI场景下的效率与适用性的质疑。通过详尽消融研究与低秩适配(LoRA),我们大幅减少可训练参数而未损失性能,同时揭示架构与训练效率是限制当前LBMs能力的关键因素。实验涵盖全模型微调与参数高效适配技术,为BCI应用提供最优训练策略。我们首次将LoRA应用于LBMs,发现同时适配多个神经网络组件通常带来性能增益。这些发现凸显了开发面向特定领域的脑电基础模型战略的必要性,暗示现有架构可能需重构以充分释放基础模型在脑电分析中的潜力。
原文摘要 · Abstract (English)
Foundation Models have demonstrated significant success across various domains in Artificial Intelligence (AI), yet their capabilities for brainwave modeling remain unclear. In this paper, we comprehensively evaluate current Large Brainwave Foundation Models (LBMs) through systematic fine-tuning experiments across multiple Brain-Computer Interface (BCI) benchmark tasks, including memory tasks and sleep stage classification. Our extensive analysis shows that state-of-the-art LBMs achieve only marginal improvements (0.9%-1.2%) over traditional deep architectures while requiring significantly more parameters (millions vs thousands), raising important questions about their efficiency and applicability in BCI contexts. Moreover, through detailed ablation studies and Low-Rank Adaptation (LoRA), we significantly reduce trainable parameters without performance degradation, while demonstrating that architectural and training inefficiencies limit LBMs' current capabilities. Our experiments span both full model fine-tuning and parameter-efficient adaptation techniques, providing insights into optimal training strategies for BCI applications. We pioneer the application of LoRA to LBMs, revealing that performance benefits generally emerge when adapting multiple neural network components simultaneously. These findings highlight the critical need for domain-specific development strategies to advance LBMs, suggesting that current architectures may require redesign to fully leverage the potential of foundation models in brainwave analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。