arXiv:2508.21103cs.LGcs.AI2025-08

用游戏数据提升脑电情绪识别,支持多粒度分类。

Spatiotemporal EEG-Based Emotion Recognition Using SAM Ratings from Serious Games with Hybrid Deep Learning

  • 构建多粒度情绪标签体系,融合二元极性、多分类与细粒度标签。
  • 基于14通道脑电信号,在4类游戏场景下实现94.5%多分类准确率。
  • 混合深度模型中LSTM-GRU表现最优,适合真实场景情绪计算。

近年来,基于脑电的情绪识别在深度学习与传统机器学习方法上均取得进展,但多数研究聚焦于二元效价预测或个体特定分类,限制了泛化能力与实际应用。为此,本文提出一个统一的多粒度脑电情绪分类框架,基于GAMEEMO数据集,包含28名受试者在四种情绪诱导游戏场景下的14通道脑电信号及连续自评情绪评分(无聊、糟糕、平静、有趣)。处理流程包括时间窗分割、混合统计与频域特征提取、z-score归一化,将原始信号转化为鲁棒判别性输入。情绪标签通过三个互补维度定义:(i) 基于正负情绪评分平均极性的二元效价分类;(ii) 预测最显著情绪状态的多分类任务;(iii) 将每种情绪分到10个序数类别的细粒度多标签表示。评估多种模型,包括随机森林、XGBoost、SVM及深层网络如LSTM、LSTM-GRU、CNN-LSTM。其中LSTM-GRU模型表现最佳,二元效价任务F1得分为0.932,多分类准确率达94.5%,多标签分类达90.6%。

原文摘要 · Abstract (English)

Recent advancements in EEG-based emotion recognition have shown promising outcomes using both deep learning and classical machine learning approaches; however, most existing studies focus narrowly on binary valence prediction or subject-specific classification, which limits generalizability and deployment in real-world affective computing systems. To address this gap, this paper presents a unified, multigranularity EEG emotion classification framework built on the GAMEEMO dataset, which consists of 14-channel EEG recordings and continuous self-reported emotion ratings (boring, horrible, calm, and funny) from 28 subjects across four emotion-inducing gameplay scenarios. Our pipeline employs a structured preprocessing strategy that comprises temporal window segmentation, hybrid statistical and frequency-domain feature extraction, and z-score normalization to convert raw EEG signals into robust, discriminative input vectors. Emotion labels are derived and encoded across three complementary axes: (i) binary valence classification based on the averaged polarity of positive and negative emotion ratings, and (ii) Multi-class emotion classification, where the presence of the most affective state is predicted. (iii) Fine-grained multi-label representation via binning each emotion into 10 ordinal classes. We evaluate a broad spectrum of models, including Random Forest, XGBoost, and SVM, alongside deep neural architectures such as LSTM, LSTM-GRU, and CNN-LSTM. Among these, the LSTM-GRU model consistently outperforms the others, achieving an F1-score of 0.932 in the binary valence task and 94.5% and 90.6% in both multi-class and Multi-Label emotion classification.

脑电情绪识别多粒度分类游戏情感深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。