arXiv:2608.02070cs.CVcs.LG2026-08

提出STEAM模型,提升脑电解码的通用性与适应效率。

STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding

论文配图:STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding
图 1 · 摘自论文原文
  • 双分支时空编码器+软专家混合机制,实现空间与时间特征协同
  • 在7个数据集14种设置中平均排名最优,推理成本可控
  • 分阶段预训练支持快速适配新任务,适合临床脑机接口应用

脑机接口广泛应用于运动康复和疾病诊断等神经工程场景。传统神经信号解码算法普遍存在泛化能力弱、适配成本高等问题,促使研究者关注脑电基础模型。现有方法难以兼顾通用迁移性、解码精度与下游高效适配。本文提出STEAM,一种分层迁移框架,将通用表征学习与范式特定专精相结合。该框架采用双分支时空编码器,通过共享软专家混合(SSMoE)模块对齐空间与时间分支,使互补表征通过少量软通道交换信息。在7个下游数据集和14个评估设置下,STEAM在平均排名上优于对比方法,且推理成本(以FLOPs计)具有竞争力。基于第一阶段通用初始化,分层预训练策略可在不从头训练的前提下,针对目标范式进行专业化,显著提升特定范式的解码准确率。

原文摘要 · Abstract (English)

Brain-computer interfaces (BCIs) have been widely used in motor rehabilitation, disease diagnosis, and other neural engineering scenarios. However, conventional neural signal decoding algorithms often suffer from limited generalizability and high adaptation costs, motivating recent interest in BCI foundation models. Existing approaches still struggle to jointly achieve general transferability, accurate decoding, and efficient downstream adaptation. We present STEAM, a hierarchical transfer framework that reconciles general-purpose representation learning with paradigm-specific specialization in EEG foundation models. The framework is instantiated as a dual-branch spatio-temporal encoder in which a shared soft mixture-of-experts (SSMoE) module aligns the spatial and temporal branches, allowing complementary representations to exchange information through a compact set of soft slots. Across seven downstream datasets and fourteen evaluation settings, STEAM attains the best average rank among the compared methods at a competitive inference cost measured in FLOPs. Building upon the Stage-I general initialization, the hierarchical pre-training strategy further specializes the model to a target paradigm without retraining from scratch, yielding consistent gains in paradigm-specific decoding accuracy.

脑机接口脑电解码专家混合预训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。