通过局部匹配解决跨被试脑电情绪识别的时间错位问题
Cross-Subject EEG Emotion Recognition Based on Temporal Asynchronous Alignment Contrastive Learning

- 将全局相似性计算改为局部细粒度匹配,自适应对齐不同被试的脑电信号
- 在多数据集上实现最高79.5%的二分类准确率,九分类达64.5%
- 适合关注跨被试泛化能力的脑机接口与情绪计算研究者
随着科技发展,情绪研究的重要性日益凸显。基于脑电(EEG)的情绪识别因具有客观性和高时间分辨率,成为近年热门方向。然而,现有方法多聚焦于优化编码器结构以提升特征提取能力,较少关注相似性计算策略,尤其忽视了不同被试间响应的时间错位问题。为此,本文借鉴自然语言处理中ColBERT的晚期交互机制,提出一种基于时间异步对齐的对比学习框架(TA2CL)。该方法将传统的全局“硬对齐”相似性计算转变为细粒度局部匹配机制,使模型能自适应搜索并对齐两段脑电信号中“局部高度相关”的片段,有效缓解个体差异与时间延迟的影响。实验结果表明,该方法在多个公开数据集上表现优异:在FACED数据集上,九分类任务准确率达64.5%,二分类任务达79.5%;在SEED和SEED-V数据集上,准确率分别为86.4%和70.1%,验证了其有效性与泛化能力。
原文摘要 · Abstract (English)
With the advancement of science and technology, the importance of emotion research has become increasingly evident. Electroencephalography (EEG)-based emotion recognition has emerged as an active research area in recent years, owing to its objectivity and high temporal resolution. However, most existing methods focus on optimizing encoder structures to enhance feature extraction capabilities, while paying relatively little attention to similarity calculation strategies, particularly overlooking the potential temporal misalignment of responses among different subjects. To address these shortcomings, this paper draws inspiration from the late interaction mechanism of ColBERT in natural language processing (NLP) and proposes a Temporal Asynchronous Alignment-based Contrastive Learning (TA2CL) framework. This method transforms the traditional global "hard alignment" similarity calculation approach into a fine-grained local matching mechanism, enabling the model to adaptively search for and align "locally highly correlated" segments between two EEG signals, thereby effectively mitigating the effects of inter-subject differences and temporal delays. Experimental results demonstrate that the proposed method achieves strong performance across multiple public datasets. Specifically, on the FACED dataset, it achieves an accuracy of 64.5% for the nine-class classification task and 79.5% for the binary classification task, while on the SEED and SEED-V datasets, it achieves accuracies of 86.4% and 70.1%, respectively, validating the method's effectiveness and generalization capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。