arXiv:2512.12135cs.LGcs.AI2025-12NeurIPS被引 4

提出可调空间尺度的脑电时空模型,提升跨区域神经活动解码性能。

BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activity

  • 设计可灵活调整空间尺度的时空变换器,支持区域级与通道级编码
  • 在多区域脑电数据上,大尺度空间编码使解码准确率显著提升
  • 兼顾区域级表征与通道级重建,适合神经科学与脑机接口研究

颅内记录为同时测量人脑多区域网络活动提供了独特机会。近期工作致力于开发基于Transformer的神经基础模型,以实现跨受试者和数据集的泛化。然而,这些记录在从单通道到脑区尺度的多种空间尺度上表现出复杂的时空交互。因此,如何有效编码空间信息,以及设计何种自监督任务以学习脑网络模式并提升下游解码性能,仍是关键开放问题。为此,我们提出一种新的多区域神经活动时空变换器模型及相应的自监督掩码潜在重建任务,支持在令牌编码和掩码时灵活选择空间尺度。在公开的多区域颅内脑电(iEEG)数据上应用该模型,我们发现调整编码与掩码的空间尺度显著影响下游解码表现;且使用大于通道级别的空间编码(如区域级)优于现有模型常用的通道级编码,显著提升解码性能。此外,我们的方法可在保持高精度通道级重建的同时实现区域级令牌编码。总体而言,该建模框架支持探索不同空间尺度的影响,揭示其对多区域人类脑活动神经基础模型自监督预训练的重要性,并提升下游解码性能。

原文摘要 · Abstract (English)

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation models of such recordings that can generalize across subjects and datasets. However, these recordings exhibit highly complex spatiotemporal interactions across diverse spatial scales, from the single-channel scale to the scale of brain regions. As such, there remain critical open questions regarding how best to encode spatial information and how to design self-supervision tasks that enable the learning of brain network patterns and enhance downstream decoding performance using such high-dimensional, multiregional recordings. To allow for exploring these questions, we propose a new spatiotemporal transformer model of multiregional neural activity and a corresponding self-supervised masked latent reconstruction task, designed to enable flexibility in the spatial scale used for token encoding and masking. Applying this model on publicly available multiregional intracranial electrophysiology (iEEG) data, we demonstrate that adjusting the spatial scale for both token encoding and masked reconstruction significantly impacts downstream decoding. Further, we find that spatial encoding at larger scales than channel-level encoding, which is commonly used in existing iEEG transformer models, improves downstream decoding performance. Finally, we demonstrate that our method allows for region-level token encoding while also maintaining accurate channel-level neural reconstruction. Taken together, our modeling framework enables exploration of the spatial scales used for token encoding and masking, reveals their importance towards self-supervised pretraining of neurofoundation models of multiregional human brain activity, and enhances downstream decoding performance.

脑电建模时空模型自监督学习神经解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。