arXiv:2410.20552cs.CVcs.AI2024-10中稿 · publication at the…被引 5

用视频预测压力水平,准确率提升近50%。

SympCam: Remote Optical Measurement of Sympathetic Arousal

  • 设计3D卷积网络+时间注意力模块,捕捉面部时序特征。
  • 预测相关性达0.77,检测生理压力准确率90%。
  • 首个专用于远程压力预测的数据集,已开源。

近期研究发现仅通过人脸视频即可估算交感神经唤醒水平,为远程医疗和压力管理提供了非侵入式方案。本文提出SympCam,一种专用于远程交感神经唤醒预测的3D卷积架构,引入时间注意力模块(TAM)增强时序建模能力。相比先前方法,其预测准确率提升48%,平均相关性达0.77。与常见远程光电容积脉搏波图(rPPG)网络对比表明,rPPG alone无法有效预测交感神经唤醒。本文方法在物理压力检测上实现90%平衡准确率,较rPPG方法提升61%。此外,我们构建了一个新数据集,包含20名参与者双摄像头同步采集的面部与手部视频,以及同步的皮肤电活动(EDA)和光电容积脉搏波图(PPG)信号。该数据集是目前首个面向远程交感神经唤醒预测的公开数据集,将向社区开放。

原文摘要 · Abstract (English)

Recent work has shown that a person's sympathetic arousal can be estimated from facial videos alone using basic signal processing. This opens up new possibilities in the field of telehealth and stress management, providing a non-invasive method to measure stress only using a regular RGB camera. In this paper, we present SympCam, a new 3D convolutional architecture tailored to the task of remote sympathetic arousal prediction. Our model incorporates a temporal attention module (TAM) to enhance the temporal coherence of our sequential data processing capabilities. The predictions from our method improve accuracy metrics of sympathetic arousal in prior work by 48% to a mean correlation of 0.77. We additionally compare our method with common remote photoplethysmography (rPPG) networks and show that they alone cannot accurately predict sympathetic arousal "out-of-the-box". Furthermore, we show that the sympathetic arousal predicted by our method allows detecting physical stress with a balanced accuracy of 90% - an improvement of 61% compared to the rPPG method commonly used in related work, demonstrating the limitations of using rPPG alone. Finally, we contribute a dataset designed explicitly for the task of remote sympathetic arousal prediction. Our dataset contains synchronized face and hand videos of 20 participants from two cameras synchronized with electrodermal activity (EDA) and photoplethysmography (PPG) measurements. We will make this dataset available to the community and use it to evaluate the methods in this paper. To the best of our knowledge, this is the first dataset available to other researchers designed for remote sympathetic arousal prediction.

压力检测视频分析生理信号数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。