用12个脑电通道实现91.57%情绪分类准确率,媲美32通道模型。
DEAP DIVE: Dataset Investigation with Vision transformers for EEG evaluation
- 将脑电信号转为时频图,用视觉变压器模型进行情绪分类。
- 仅用12个通道即达91.57%准确率,显著少于现有32通道方案。
- 适合低资源脑机接口与便携式情绪检测场景研究者参考。
从脑信号中准确预测情绪有望推动心理健康、人机交互和情感计算的发展。通过神经信号进行情绪识别为传统方法(如自评和面部表情分析)提供了更直接、客观的替代方案。脑电图(EEG)测量能提供更直接且无偏的数据源。然而,全量脑电采集过程复杂且资源消耗大,促使低成本脑电设备发展。本研究探讨了在DEAP数据集上,使用部分脑电通道能否实现足够准确的情绪预测,以适配低成本设备。通过连续小波变换将脑电数据转化为尺度图,训练了视觉变压器(ViT)模型进行情绪分类。结果表明,仅使用12个测量点(通道),模型在4个象限(高/低唤醒度与效价)分类任务中达到超过91.57%的准确率。相比当前最优96.9%准确率(使用32通道),显著降低输入通道数仍保持高性能。训练代码可在此处获取:https://gitlab.kit.edu/kit/aifb/ATKS/public/AutoSMiLeS/DEAP-DIVE。
原文摘要 · Abstract (English)
Accurately predicting emotions from brain signals has the potential to achieve goals such as improving mental health, human-computer interaction, and affective computing. Emotion prediction through neural signals offers a promising alternative to traditional methods, such as self-assessment and facial expression analysis, which can be subjective or ambiguous. Measurements of the brain activity via electroencephalogram (EEG) provides a more direct and unbiased data source. However, conducting a full EEG is a complex, resource-intensive process, leading to the rise of low-cost EEG devices with simplified measurement capabilities. This work examines how subsets of EEG channels from the DEAP dataset can be used for sufficiently accurate emotion prediction with low-cost EEG devices, rather than fully equipped EEG-measurements. Using Continuous Wavelet Transformation to convert EEG data into scaleograms, we trained a vision transformer (ViT) model for emotion classification. The model achieved over 91,57% accuracy in predicting 4 quadrants (high/low per arousal and valence) with only 12 measuring points (also referred to as channels). Our work shows clearly, that a significant reduction of input channels yields high results compared to state-of-the-art results of 96,9% with 32 channels. Training scripts to reproduce our code can be found here: https://gitlab.kit.edu/kit/aifb/ATKS/public/AutoSMiLeS/DEAP-DIVE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。