arXiv:2510.05826eess.SPcs.CV2025-10

用改进的ViT模型分析心电图像,精准识别七类情绪状态。

Leveraging Vision Transformers for Enhanced Classification of Emotions using ECG Signals

  • 将心电信号转为图像,结合卷积与注意力机制提升分类性能。
  • 在YAAD数据集上情绪分类准确率达92.3%,优于现有方法。
  • 适合关注生理信号情绪识别、医疗健康应用的研究者。

生物医学信号揭示人体多种状态。心电图(ECG)可反映心率变异性变化,与情绪唤起、压力水平及自主神经系统活动相关,为情绪的生理基础提供窗口。本文探索视觉变压器(ViT)在图像化心电图上的情绪识别能力,并提出融合卷积神经网络(CNN)与注意力门控(SE)模块的增强版ViT。首先通过连续小波变换和功率谱密度分析对信号进行去噪并转换为可解释图像;随后构建强化型视觉变压器,以应对情绪识别挑战。在YAAD和DREAMER两个数据集上验证,该方法在7类情绪分类任务中达到92.3%准确率,在情感维度(效价、唤醒度、支配度)分类中也优于当前最优技术。

原文摘要 · Abstract (English)

Biomedical signals provide insights into various conditions affecting the human body. Beyond diagnostic capabilities, these signals offer a deeper understanding of how specific organs respond to an individual's emotions and feelings. For instance, ECG data can reveal changes in heart rate variability linked to emotional arousal, stress levels, and autonomic nervous system activity. This data offers a window into the physiological basis of our emotional states. Recent advancements in the field diverge from conventional approaches by leveraging the power of advanced transformer architectures, which surpass traditional machine learning and deep learning methods. We begin by assessing the effectiveness of the Vision Transformer (ViT), a forefront model in image classification, for identifying emotions in imaged ECGs. Following this, we present and evaluate an improved version of ViT, integrating both CNN and SE blocks, aiming to bolster performance on imaged ECGs associated with emotion detection. Our method unfolds in two critical phases: first, we apply advanced preprocessing techniques for signal purification and converting signals into interpretable images using continuous wavelet transform and power spectral density analysis; second, we unveil a performance-boosted vision transformer architecture, cleverly enhanced with convolutional neural network components, to adeptly tackle the challenges of emotion recognition. Our methodology's robustness and innovation were thoroughly tested using ECG data from the YAAD and DREAMER datasets, leading to remarkable outcomes. For the YAAD dataset, our approach outperformed existing state-of-the-art methods in classifying seven unique emotional states, as well as in valence and arousal classification. Similarly, in the DREAMER dataset, our method excelled in distinguishing between valence, arousal and dominance, surpassing current leading techniques.

情绪识别心电信号视觉变压器深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。