arXiv:2409.07493eess.SPcs.AI2024-09综述被引 8

融合面部表情与生理信号,用多模态数据识别复杂情绪

Complex Emotion Recognition System using basic emotions via Facial Expression, EEG, and ECG Signals: a review

  • 结合面部表情、脑电和心电信号,分析基本情绪组合与动态变化
  • 多模态数据提升情绪识别准确率,增强系统可靠性
  • 适合心理医疗、人机交互领域研究者参考

复杂情绪识别系统(CERS)通过分析基本情绪的组合、相互关系及动态变化,揭示复杂情感状态。该系统利用先进算法深入理解情绪演化过程,实现个性化响应。机器实现此类情绪识别需借鉴人类认知机制,涉及知识蒸馏与新概念理解。开发用于识别复杂情绪的AI系统面临巨大挑战,且获取大规模高质量数据极为困难,因捕捉细微情绪需特殊采集与处理方法。引入心电图(ECG)和脑电图(EEG)等生理信号可显著提升系统性能,提供更精准的情绪洞察,改善数据质量并增强可靠性。本研究开展全面文献综述,评估机器学习、深度学习及元学习在基于EEG、ECG与面部表情数据集的基本与复杂情绪识别中的有效性。所选研究提供了潜在应用、临床意义及系统表现见解,旨在推动其在临床决策中的采纳。同时指出当前研究空白与挑战,呼吁进一步探索。最后强调元学习在提升CERS性能中的关键作用,指引未来研究方向。

原文摘要 · Abstract (English)

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS provides profound insights into emotional dynamics, facilitating a nuanced understanding and customized responses. The attainment of such a level of emotional recognition in machines necessitates the knowledge distillation and the comprehension of novel concepts akin to human cognition. The development of AI systems for discerning complex emotions poses a substantial challenge with significant implications for affective computing. Furthermore, obtaining a sizable dataset for CERS proves to be a daunting task due to the intricacies involved in capturing subtle emotions, necessitating specialized methods for data collection and processing. Incorporating physiological signals such as Electrocardiogram (ECG) and Electroencephalogram (EEG) can notably enhance CERS by furnishing valuable insights into the user's emotional state, enhancing the quality of datasets, and fortifying system dependability. A comprehensive literature review was conducted in this study to assess the efficacy of machine learning, deep learning, and meta-learning approaches in both basic and complex emotion recognition utilizing EEG, ECG signals, and facial expression datasets. The chosen research papers offer perspectives on potential applications, clinical implications, and results of CERSs, with the objective of promoting their acceptance and integration into clinical decision-making processes. This study highlights research gaps and challenges in understanding CERSs, encouraging further investigation by relevant studies and organizations. Lastly, the significance of meta-learning approaches in improving CERS performance and guiding future research endeavors is underscored.

情绪识别多模态脑电心电

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。