arXiv:2507.06080cs.CV2025-07

构建首个非接触式多模态生理情绪数据集,支持远程情感识别

CAST-Phys: Contactless Affective States Through Physiological signals Database

  • 设计非接触式多模态生理信号采集方案,融合面部视频与生理指标
  • 包含PPG、EDA、呼吸率等多类信号,支持远程情绪状态分析
  • 适用于远程心理健康监测与无感交互系统开发

近年来,情感计算及其应用成为快速发展的研究领域。尽管取得了显著进展,但缺乏多模态情感数据集仍是构建精准情绪识别系统的主要瓶颈。此外,情绪诱发过程中使用接触式设备常无意影响情感体验,削弱或改变真实自发的情绪反应。这凸显了从多种模态中无接触提取情感线索的必要性,例如远程生理情绪识别。为此,我们提出了非接触式情感状态生理信号数据库(CAST-Phys),一个专为多模态远程生理情绪识别设计的高质量数据集,结合面部与生理线索。数据集包含多种生理信号,如光体积描记法(PPG)、皮肤电活动(EDA)和呼吸率(RR),以及高分辨率未压缩面部视频记录,支持远程信号恢复。分析表明,在面部表情不足以提供足够信息的真实场景中,生理信号起关键作用。通过评估单一模态与融合模态的影响,我们展示了远程多模态情绪识别的潜力,推动无接触情绪识别技术的发展。

原文摘要 · Abstract (English)

In recent years, affective computing and its applications have become a fast-growing research topic. Despite significant advancements, the lack of affective multi-modal datasets remains a major bottleneck in developing accurate emotion recognition systems. Furthermore, the use of contact-based devices during emotion elicitation often unintentionally influences the emotional experience, reducing or altering the genuine spontaneous emotional response. This limitation highlights the need for methods capable of extracting affective cues from multiple modalities without physical contact, such as remote physiological emotion recognition. To address this, we present the Contactless Affective States Through Physiological Signals Database (CAST-Phys), a novel high-quality dataset explicitly designed for multi-modal remote physiological emotion recognition using facial and physiological cues. The dataset includes diverse physiological signals, such as photoplethysmography (PPG), electrodermal activity (EDA), and respiration rate (RR), alongside high-resolution uncompressed facial video recordings, enabling the potential for remote signal recovery. Our analysis highlights the crucial role of physiological signals in realistic scenarios where facial expressions alone may not provide sufficient emotional information. Furthermore, we demonstrate the potential of remote multi-modal emotion recognition by evaluating the impact of individual and fused modalities, showcasing its effectiveness in advancing contactless emotion recognition technologies.

情感计算非接触感知生理信号多模态数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。