arXiv:2602.23771eess.IVcs.CV2026-02

用视频无接触测新生儿心率和血氧,精度接近传统方法。

VideoPulse: Neonatal heart rate and peripheral capillary oxygen saturation (SpO2) estimation from contact free video

  • 通过面部视频+3D CNN模型,实现无接触生命体征估计。
  • 心率误差仅2.97 bpm,血氧误差1.69%,满足临床需求。
  • 适合早产儿监护场景,降低皮肤刺激与感染风险。

远程光电容积脉搏波描记术(rPPG)可实现无接触生命体征监测,对皮肤脆弱的新生儿尤为重要。本文提出VideoPulse数据集及端到端算法,从面部视频中估计新生儿心率和外周毛细血管血氧饱和度(SpO2)。该数据集包含52名新生儿的157段视频,总时长2.6小时,涵盖多种面部朝向。算法采用人脸对齐与去噪脉搏血氧信号进行抗伪影监督,结合3D CNN骨干网络进行心率与SpO2回归,并使用标签分布平滑和加权回归优化SpO2预测。结果以2秒窗口输出,于NBHR数据集上取得心率平均绝对误差(MAE)2.97 bpm(6秒窗口为2.80 bpm),SpO2 MAE 1.69%。跨数据集评估显示,基于NBHR训练的心率模型在VideoPulse上达5.34 bpm MAE;微调预训练的SpO2模型后,误差降至1.68%。结果表明,短时非对齐视频即可支持高精度心率与血氧估计,推动新生儿重症监护中低成本、无创监测的发展。

原文摘要 · Abstract (English)

Remote photoplethysmography (rPPG) enables contact free monitoring of vital signs and is especially valuable for neonates, since conventional methods often require sustained skin contact with adhesive probes that can irritate fragile skin and increase infection control burden. We present VideoPulse, a neonatal dataset and an end to end pipeline that estimates neonatal heart rate and peripheral capillary oxygen saturation (SpO2) from facial video. VideoPulse contains 157 recordings totaling 2.6 hours from 52 neonates with diverse face orientations. Our pipeline performs face alignment and artifact aware supervision using denoised pulse oximeter signals, then applies 3D CNN backbones for heart rate and SpO2 regression with label distribution smoothing and weighted regression for SpO2. Predictions are produced in 2 second windows. On the NBHR neonatal dataset, we obtain heart rate MAE 2.97 bpm using 2 second windows (2.80 bpm at 6 second windows) and SpO2 MAE 1.69 percent. Under cross dataset evaluation, the NBHR trained heart rate model attains 5.34 bpm MAE on VideoPulse, and fine tuning an NBHR pretrained SpO2 model on VideoPulse yields MAE 1.68 percent. These results indicate that short unaligned neonatal video segments can support accurate heart rate and SpO2 estimation, enabling low cost non invasive monitoring in neonatal intensive care.

新生儿监测无接触检测视频生理信号医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。