用脑区间动态交互建模提升脑电情绪识别准确率
A Brain Wave Encodes a Thousand Tokens: Modeling Inter-Cortical Neural Interactions for Effective EEG-based Emotion Recognition
- 将脑电信号转为频带熵令牌,通过电极身份嵌入保留空间信息
- 基于注意力机制构建脑区间依赖关系矩阵,捕捉动态神经交互
- 在三个数据集上全面超越现有方法,适合脑机接口与情绪计算研究者
人类情绪难以用语言准确表达,而脑电图(EEG)信号能更直接反映大脑情绪活动。尽管深度学习模型已实现高精度情绪识别,但多数方法忽视了不同脑区间的动态交互,而这一机制对理解情绪演变至关重要。为此,本文提出RBTransformer,一种基于Transformer的神经网络架构,通过潜空间建模脑区间神经动态,以捕捉结构化神经交互。首先将EEG信号转换为频带差分熵(BDE)令牌,并引入电极身份嵌入以保留空间位置信息;随后通过多头注意力层构建电极-电极注意力矩阵,学习脑区间依赖关系;最终输出分类结果。我们在SEED、DEAP和DREAMER三个数据集上,针对效价、唤醒度和支配度三个维度,在主试内设置下,进行了二分类与多分类实验。结果表明,RBTransformer在所有数据集、所有维度及两种分类设置下均优于当前最先进方法。代码已开源:https://github.com/nnilayy/RBTransformer。
原文摘要 · Abstract (English)
Human emotions are difficult to convey through words and are often abstracted in the process; however, electroencephalogram (EEG) signals can offer a more direct lens into emotional brain activity. Recent studies show that deep learning models can process these signals to perform emotion recognition with high accuracy. However, many existing approaches overlook the dynamic interplay between distinct brain regions, which can be crucial to understanding how emotions unfold and evolve over time, potentially aiding in more accurate emotion recognition. To address this, we propose RBTransformer, a Transformer-based neural network architecture that models inter-cortical neural dynamics of the brain in latent space to better capture structured neural interactions for effective EEG-based emotion recognition. First, the EEG signals are converted into Band Differential Entropy (BDE) tokens, which are then passed through Electrode Identity embeddings to retain spatial provenance. These tokens are processed through successive inter-cortical multi-head attention blocks that construct an electrode x electrode attention matrix, allowing the model to learn the inter-cortical neural dependencies. The resulting features are then passed through a classification head to obtain the final prediction. We conducted extensive experiments, specifically under subject-dependent settings, on the SEED, DEAP, and DREAMER datasets, over all three dimensions, Valence, Arousal, and Dominance (for DEAP and DREAMER), under both binary and multi-class classification settings. The results demonstrate that the proposed RBTransformer outperforms all previous state-of-the-art methods across all three datasets, over all three dimensions under both classification settings. The source code is available at: https://github.com/nnilayy/RBTransformer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。