提出新自监督框架,提升跨数据集脑电情绪识别能力
Masked Generative-Contrastive Representation Learning for Cross-Dataset EEG-Based Emotion Recognition
- 设计区域感知时空编码器,应对不同电极配置
- 结合生成与对比学习,捕捉噪声鲁棒的细微情绪特征
- 适合跨被试、跨数据集的情绪识别研究者使用
自监督学习(SSL)在提升特征表示和泛化能力方面潜力巨大,但在脑电情绪识别中的应用仍不充分。现有方法难以捕捉不同电极配置下脑电信号复杂的时空依赖性,提取对噪声敏感的细粒度表示,并获得跨被试通用的全局特征。为此,我们提出面向脑电情绪识别的掩码生成-对比表示学习(MGCRL)框架。基于区域感知时空编码器,MGCRL融合生成与对比学习,实现细粒度与全局判别性表征以支持跨数据集泛化。其核心设计包括:1)引入基于区域的图卷积,捕捉局部空间与功能关系,增强区域特异性特征学习并缓解电极配置差异影响;2)基于联合嵌入预测架构(JEPA)的生成机制,利用掩码特征学习抗噪的细粒度表示,提升对微弱情绪状态的刻画能力;3)采用掩码与原始特征的对比策略,学习同一刺激下的时序稳定且跨被试不变的表示,增强情绪判别力与跨被试泛化性能。大量实验表明,预训练于FACED数据集并在多个SEED系列数据集上微调,MGCRL展现出强大的通用表征学习能力。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) shows strong potential for cross-dataset transfer by improving feature representation and generalization. However, its application to EEG-based emotion recognition remains largely unexplored. Existing SSL methods struggle to capture the intricate spatiotemporal dependencies of EEG signals under varying channel configurations, extract fine-grained representations resilient to noise, and derive global features that generalize well across subjects. To address these challenges, we propose Masked Generative-Contrastive Representation Learning (MGCRL), a novel SSL framework specifically designed for EEG-based emotion recognition. Built upon a region-aware spatiotemporal encoder, MGCRL integrates generative and contrastive learning to achieve both fine-grained and global discriminative representations for cross-dataset generalization. MGCRL introduces three key designs: 1) a spatiotemporal encoder that incorporates region-based graph convolution to capture localized spatial and functional relationships, enhancing region-specific feature learning and mitigating the impact of varying EEG channel configurations across datasets; 2) a generative learning mechanism based on the joint embedding predictive architecture (JEPA) that utilizes masked features to capture noise robustness fine-grained representations, improving the model's capability to characterize subtle emotional states; and 3) a contrastive learning strategy that leverages masked and original features to learn temporally stable and cross-subject-invariant representations across the same stimuli, boosting emotion discrimination and cross-subject generalization. Under these designs, MGCRL exhibits remarkable ability to learn universal representation. Extensive experiments involving pretraining on the large FACED dataset and fine-tuning on multiple SEED-series datasets demonstrate the effectiveness of MGCRL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。