专为新生儿病房设计的面部检测模型,提升疼痛评估准确性。
InfantFace: Detecting infant faces in neonatal clinical environments
- 基于YOLOv11m的单阶段模型,适配新生儿临床环境。
- 微调后检测准确率(AP50)达0.96,优于现有通用模型。
- 解决设备遮挡、光线差等临床难题,适合医疗视频分析场景。
可靠的新生儿面部定位是基于摄像头的非接触式评估(如疼痛表情分析、呼吸信号提取、窒息警报)的基础。然而,临床环境中存在背景杂乱、光照变化、设备遮挡等问题,严重影响检测精度。本文提出一种面向新生儿临床环境的一阶段YOLOv11m模型,融合VGGFace2、CelebA、FDDB、WIDER FACE等多个公开数据集进行训练与评估,并在包含113名独立婴儿、228段视频的新生儿研究数据集上进行微调。微调前模型的AP50为0.87,超越三种先进通用人脸检测器;微调后性能提升至AP50 0.96。由于缺乏公开的新生儿数据集,跨数据集评估仍具挑战。未来需优先构建符合隐私与伦理标准的新生儿数据集,以推动该领域发展。
原文摘要 · Abstract (English)
Reliable localisation of the neonatal face is the first step for several video-camera based non-contact assessments such as pain and distress related facial expression analysis, pain scoring, cardiorespiratory signal extraction and cessation of breathing alerts. However, major challenges persist in neonatal clinical environments. Cluttered backgrounds, illumination changes and poor lighting conditions can reduce the accuracy of face detection models. Clinical interventions, monitoring equipment and, in some cases, medical devices can obstruct the face, making visual assessment difficult. We propose a one-stage YOLOv11m-based model tailored for face detection of infants in neonatal clinical environments. We combined multiple publicly available datasets (VGGFace2, CelebA, FDDB, WIDER FACE) to train and evaluate our proposed model. We then fine-tuned our model on a neonatal research dataset involving 228 videos from 114 recording sessions of 113 independent infants. Before fine-tuning, our model achieved an AP50 of 0.87, surpassing the performance of three state-of-the-art general face detectors. Performance improved further to an AP50 of 0.96 after clinical-domain adaptation. Evaluating face detection performance across different datasets remains a challenge due to the lack of publicly available neonatal datasets. Prioritising the creation of such datasets, while upholding appropriate privacy safeguards and ethical standards in their creation and use, would greatly support further progress in this field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。