用事件相机无接触测心跳,精度接近传统摄像头。
Contactless Cardiac Pulse Monitoring Using Event Cameras
- 用卷积神经网络从事件相机数据中提取心率信号
- 事件相机在60/120帧下误差低至2.54/2.13 bpm
- 适合远程健康监测、低功耗场景应用
时间事件相机是一种新型低延迟、低功耗的场景记录技术,以事件流形式输出像素级亮度变化信息,具有更高动态范围和时间分辨率。本研究探索利用事件相机对人脸进行非接触式心脏脉搏信号重建,采用监督卷积神经网络(CNN)模型实现端到端心率提取。模型性能基于计算心率的准确度评估。实验表明,面部区域的生理心脏信息有效保留在事件流中,验证了该传感器在远程心率监测中的潜力。在事件帧上训练的模型达到3.32 bpm的均方根误差(RMSE),优于标准相机帧训练的基准模型(2.92 bpm)。此外,60和120帧/秒事件相机生成的模型分别达到2.54和2.13 bpm的RMSE,优于30帧/秒标准相机结果。
原文摘要 · Abstract (English)
Time event cameras are a novel technology for recording scene information at extremely low latency and with low power consumption. Event cameras output a stream of events that encapsulate pixel-level light intensity changes within the scene, capturing information with a higher dynamic range and temporal resolution than traditional cameras. This study investigates the contact-free reconstruction of an individual's cardiac pulse signal from time event recording of their face using a supervised convolutional neural network (CNN) model. An end-to-end model is trained to extract the cardiac signal from a two-dimensional representation of the event stream, with model performance evaluated based on the accuracy of the calculated heart rate. The experimental results confirm that physiological cardiac information in the facial region is effectively preserved within the event stream, showcasing the potential of this novel sensor for remote heart rate monitoring. The model trained on event frames achieves a root mean square error (RMSE) of 3.32 beats per minute (bpm) compared to the RMSE of 2.92 bpm achieved by the baseline model trained on standard camera frames. Furthermore, models trained on event frames generated at 60 and 120 FPS outperformed the 30 FPS standard camera results, achieving an RMSE of 2.54 and 2.13 bpm, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。