arXiv:2506.23075cs.HCcs.LG2025-06NeurIPS被引 51

提出跨尺度脑电解码模型CSBrain,提升神经信号理解能力。

CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding

  • 设计跨尺度时空分词机制,融合局部时间窗与脑区特征
  • 引入结构化稀疏注意力,捕捉多尺度依赖关系并去除伪相关
  • 在16个数据集11项任务上超越现有模型,适合脑机接口研究

从脑电图(EEG)信号中理解与解码脑活动是神经科学与人工智能的基础挑战,应用于认知、情绪识别、诊断及脑机接口。尽管近期的EEG基础模型通过统一架构与大规模预训练推进了通用解码,但其采用源自自然语言处理和视觉的无尺度密集建模范式,忽略了神经活动的核心特性:跨尺度时空结构。EEG任务模式涵盖从短时爆发到慢波节律、从局部皮层反应到广泛脑区互动的多种时空尺度。忽略这种多样性导致表征欠优且泛化能力弱。我们提出CSBrain,一种用于通用脑电解码的跨尺度时空脑基础模型。CSBrain引入:(i) 跨尺度时空分词(CST),将局部时间窗口与解剖脑区的多尺度特征聚合为具尺度感知的紧凑标记;(ii) 结构化稀疏注意力(SSA),捕捉跨窗口与跨区域依赖,增强尺度多样性的同时消除伪相关。CST与SSA交替堆叠,逐步整合多尺度依赖。在16个数据集上的11项EEG任务实验表明,CSBrain持续优于任务特定模型与基础模型。结果确立跨尺度建模作为关键归纳偏置,并将CSBrain定位为未来脑-人工智能研究的稳健骨干。

原文摘要 · Abstract (English)

Understanding and decoding brain activity from electroencephalography (EEG) signals is a fundamental challenge in neuroscience and AI, with applications in cognition, emotion recognition, diagnosis, and brain-computer interfaces. While recent EEG foundation models advance generalized decoding via unified architectures and large-scale pretraining, they adopt a scale-agnostic dense modeling paradigm inherited from NLP and vision. This design neglects a core property of neural activity: cross-scale spatiotemporal structure. EEG task patterns span a wide range of temporal and spatial scales, from short bursts to slow rhythms, and from localized cortical responses to distributed interactions. Ignoring this diversity leads to suboptimal representations and weak generalization. We propose CSBrain, a Cross-scale Spatiotemporal Brain foundation model for generalized EEG decoding. CSBrain introduces: (i) Cross-scale Spatiotemporal Tokenization (CST), which aggregates multi-scale features from localized temporal windows and anatomical brain regions into compact scale-aware tokens; and (ii) Structured Sparse Attention (SSA), which captures cross-window and cross-region dependencies, enhancing scale diversity while removing spurious correlations. CST and SSA are alternately stacked to progressively integrate multi-scale dependencies. Experiments on 11 EEG tasks across 16 datasets show that CSBrain consistently outperforms task-specific and foundation model baselines. These results establish cross-scale modeling as a key inductive bias and position CSBrain as a robust backbone for future brain-AI research.

脑电解码跨尺度建模基础模型脑机接口

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。