arXiv:2502.17482eess.SPcs.LG2025-02被引 10

用多视角对比学习提升脑机接口的运动想象识别精度

MVCNet: Multi-View Contrastive Network for Motor Imagery Classification

  • 双分支结构融合卷积与变换器,捕捉时空特征和全局依赖
  • 在五个公开数据集上平均准确率超现有模型3.2个百分点
  • 适合需要高鲁棒性的脑机接口研究与应用

基于脑电图(EEG)的脑机接口通过解码脑活动实现神经交互。运动想象(MI)解码因其直观机制受到广泛关注。然而,现有模型多采用单流架构,忽视了EEG信号的多视角特性,导致性能与泛化能力受限。本文提出多视角对比网络(MVCNet),一种双分支架构,平行集成卷积神经网络与变换器模块,以捕获局部时空特征和全局时间依赖性。为增强训练数据信息量,MVCNet引入跨时间、频率和空间域的统一增强管道。进一步设计两个对比模块:跨视角对比模块强制原始视图与增强视图的一致性,跨模型对比模块对齐双分支提取的特征。最终表示通过对比损失与分类损失联合优化。在五个公共MI数据集上的三类场景实验表明,MVCNet持续优于九种先进模型,验证其有效性和泛化能力。MVCNet通过整合多视角信息与双分支建模,为运动想象解码提供稳健方案,推动更可靠的脑机接口系统发展。

原文摘要 · Abstract (English)

Electroencephalography (EEG)-based brain-computer interfaces (BCIs) enable neural interaction by decoding brain activity for external communication. Motor imagery (MI) decoding has received significant attention due to its intuitive mechanism. However, most existing models rely on single-stream architectures and overlook the multi-view nature of EEG signals, leading to limited performance and generalization. We propose a multi-view contrastive network (MVCNet), a dual-branch architecture that parallelly integrates CNN and Transformer blocks to capture both local spatial-temporal features and global temporal dependencies. To enhance the informativeness of training data, MVCNet incorporates a unified augmentation pipeline across time, frequency, and spatial domains. Two contrastive modules are further introduced: a cross-view contrastive module that enforces consistency of original and augmented views, and a cross-model contrastive module that aligns features extracted from both branches. Final representations are fused and jointly optimized by contrastive and classification losses. Experiments on five public MI datasets across three scenarios demonstrate that MVCNet consistently outperforms nine state-of-the-art MI decoding networks, highlighting its effectiveness and generalization ability. MVCNet provides a robust solution for MI decoding by integrating multi-view information and dual-branch modeling, contributing to the development of more reliable BCI systems.

脑机接口运动想象对比学习EEG解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。