建立统一评估框架,让脑电情绪识别研究可比可复现。
Evaluation in EEG Emotion Recognition: State-of-the-Art Review and Unified Framework
- 提出EEGain统一评估框架,规范数据处理与划分方式。
- 在6个主流数据集上验证,支持4种经典模型对比。
- 适合希望提升实验可比性与可复现性的研究者使用。
近年来,基于脑电图的情绪识别(EEG-ER)成为热门研究方向。我们分析了2018至2023年间发表的216篇论文,发现该领域缺乏统一的评估协议,导致难以公平定义当前技术水平、比较新方法或追踪进展。主要不一致体现在真实标签定义、评估指标选择、数据划分方式(如被试相关或被试无关)以及使用不同数据集等方面。基于此现状,我们提出了EEGain开源框架(https://github.com/EmotionLab/EEGain),实现新方法与数据集的便捷高效评估。EEGain提供标准化的数据预处理、数据划分、评估指标,并支持仅一行代码加载六大核心数据集(AMIGOS、DEAP、DREAMER、MAHNOB-HCI、SEED、SEED-IV)。我们还使用这六个数据集,在四种主流公开方法(EEGNet、DeepConvNet、ShallowConvNet、TSception)上验证并评估了EEGain。此举显著提升了EEG-ER研究的可复现性与可比性,推动领域整体进步。
原文摘要 · Abstract (English)
Electroencephalography-based Emotion Recognition (EEG-ER) has become a growing research area in recent years. Analyzing 216 papers published between 2018 and 2023, we uncover that the field lacks a unified evaluation protocol, which is essential to fairly define the state of the art, compare new approaches and to track the field's progress. We report the main inconsistencies between the used evaluation protocols, which are related to ground truth definition, evaluation metric selection, data splitting types (e.g., subject-dependent or subject-independent) and the use of different datasets. Capitalizing on this state-of-the-art research, we propose a unified evaluation protocol, EEGain (https://github.com/EmotionLab/EEGain), which enables an easy and efficient evaluation of new methods and datasets. EEGain is a novel open source software framework, offering the capability to compare - and thus define - state-of-the-art results. EEGain includes standardized methods for data pre-processing, data splitting, evaluation metrics, and the ability to load the six most relevant datasets (i.e., AMIGOS, DEAP, DREAMER, MAHNOB-HCI, SEED, SEED-IV) in EEG-ER with only a single line of code. In addition, we have assessed and validated EEGain using these six datasets on the four most common publicly available methods (EEGNet, DeepConvNet, ShallowConvNet, TSception). This is a significant step to make research on EEG-ER more reproducible and comparable, thereby accelerating the overall progress of the field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。