arXiv:2507.03633cs.CVcs.AI2025-07被引 4

将视频模型迁移到脑电分析,提升时空特征捕捉能力。

From Video to EEG: Adapting Joint Embedding Predictive Architecture to Uncover Saptiotemporal Dynamics in Brain Signal Analysis

  • 把脑电信号当视频序列处理,用联合嵌入和自适应掩码学习特征。
  • 在TUH数据集上分类准确率超越现有最佳模型。
  • 生成可解释的脑电模式,适合临床诊断辅助场景。

脑电图(EEG)以高时间分辨率捕捉大脑活动,但受限于标注数据少、维度高及缺乏能充分建模时空依赖的可扩展模型。现有自监督学习方法多只关注空间或时间特征,导致表征效果不佳。本文提出EEG-VJEPA,首次将视频联合嵌入预测架构(V-JEPA)适配至EEG分类任务。通过将EEG视为类视频序列,利用联合嵌入与自适应掩码学习语义丰富的时空表征。在公开的坦普尔大学医院异常EEG数据集(TUH Abnormal EEG)上的实验表明,EEG-VJEPA在分类准确率上优于当前最优模型。此外,该模型能捕获具有生理意义的空间与时间信号模式,生成可解释的嵌入,有助于人机协作支持诊断流程。这些成果使EEG-VJEPA成为真实临床环境中可扩展、可信的脑电分析框架。

原文摘要 · Abstract (English)

EEG signals capture brain activity with high temporal and low spatial resolution, supporting applications such as neurological diagnosis, cognitive monitoring, and brain-computer interfaces. However, effective analysis is hindered by limited labeled data, high dimensionality, and the absence of scalable models that fully capture spatiotemporal dependencies. Existing self-supervised learning (SSL) methods often focus on either spatial or temporal features, leading to suboptimal representations. To this end, we propose EEG-VJEPA, a novel adaptation of the Video Joint Embedding Predictive Architecture (V-JEPA) for EEG classification. By treating EEG as video-like sequences, EEG-VJEPA learns semantically meaningful spatiotemporal representations using joint embeddings and adaptive masking. To our knowledge, this is the first work that exploits V-JEPA for EEG classification and explores the visual concepts learned by the model. Evaluations on the publicly available Temple University Hospital (TUH) Abnormal EEG dataset show that EEG-VJEPA outperforms existing state-of-the-art models in classification accuracy. Beyond classification accuracy, EEG-VJEPA captures physiologically relevant spatial and temporal signal patterns, offering interpretable embeddings that may support human-AI collaboration in diagnostic workflows. These findings position EEG-VJEPA as a promising framework for scalable, trustworthy EEG analysis in real-world clinical settings.

脑电分析自监督学习时空建模可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。