用非接触式摄像头检测新生儿疼痛,提升重症监护室评估准确性
Exploring Remote Photoplethysmography for Neonatal Pain Detection from Facial Videos

- 通过面部视频提取远程光电容积脉搏波信号
- 蓝光通道信号最有效,融合声音特征性能更优
- 适合新生儿疼痛监测与临床辅助诊断场景
未处理的新生儿疼痛可能导致发育迟缓和体重增长缓慢,亟需更客观可靠的评估方法。传统接触式生理参数测量不适用于长期监测,且增加传染病传播风险。本文提出一种基于远程光电容积脉搏波(rPPG)的非接触式方法,从面部视频中估计心率信号,用于新生儿疼痛检测。由于皮肤形变影响区域的时间信号质量较低,我们引入质量参数,筛选受形变影响最小的区域信号。同时采用信噪比作为优化指标,选取噪声最小的信号片段。实验表明,rPPG信号对疼痛检测有显著帮助,其中蓝光通道信号优于其他颜色通道。此外,结合rPPG与音频特征的多模态方法表现优于单一模态。
原文摘要 · Abstract (English)
Unaddressed pain in neonates can lead to adverse effects, including delayed development and slower weight gain, emphasising the need for more objective and reliable pain assessment methods. Hence, automated methods using behavioural and physiological pain indicators have been developed to aid healthcare professionals in the Neonatal ICU. Traditional contact-based methods for physiological parameter estimation are unsuitable for long-term monitoring and increase the risk of spreading diseases like COVID-19. We introduce a novel approach using remote photoplethysmography (rPPG) to estimate pulse signals in a non-contact manner and employ them for neonatal pain detection. The temporal signals acquired from regions-of-interest (ROIs) affected by skin deformations may exhibit lower quality and provide erroneous rPPG signals. Therefore, we incorporated a quality parameter to select the temporal signals obtained from ROIs that are least affected by skin deformations. Further, we employed signal-to-noise ratio as a fitness parameter to extract the rPPG signal corresponding to the clip that is least affected by noise. Experimental findings demonstrate that the rPPG signals provide useful information for neonatal pain detection, and signals extracted from the blue colour channel outperform those extracted from other colour channels. We also show that combining rPPG and audio features provides better results than individual modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。