arXiv:2606.20823cs.CV2026-06

首个端到端68点新生儿面部关键点定位模型,解决临床环境下的检测难题。

NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments

论文配图:NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments
图 1 · 摘自论文原文
  • 基于YOLO的端到端模型,融合多源数据训练,适应新生儿复杂拍摄条件。
  • 在临床测试集上失败率降至1.77%,关键点误差达6.36,性能领先。
  • 适用于新生儿疼痛评估与健康监测,尤其适合临床医疗场景使用。

面部关键点定位是实现自动化、非接触式新生儿疼痛评估的基础。临床中常通过疼痛量表判断疼痛程度,而这些量表依赖面部表情。然而,基于成人面部训练的检测器在新生儿临床环境中表现不佳,主要因医疗设备遮挡、头部姿态多样及运动模糊等挑战。本文提出一种端到端的68点新生儿面部关键点检测模型。我们整合了来自11个公开数据集的37,459张单人脸图像(统一标注为68点),并加入1,123帧由研究人员手动标注的新生儿数据集帧(总计超过76,000个关键点)。采用基于YOLO的关键点回归模型,并以预训练新生儿面部检测器权重初始化。在公开数据集上,模型达到最优性能:归一化平均误差(NME)= 5.37,失败率(FR)= 12.5%,累积误差曲线下面积(AUC)在AUC0.08 = 38.00%,AUC0.1 = 48.70%。在临床新生儿测试集上,未微调时即实现最低检测失败率(DFR)= 5.3%,展现强泛化能力;微调后性能进一步提升至NME = 6.36,FR = 22.30%,DFR = 1.77%,AUC0.08 = 29.24%,AUC0.1 = 40.25%。据我们所知,这是首个端到端的68点新生儿面部关键点检测模型。随着数据扩展与优化,有望支持新生儿健康监测与疼痛相关面部分析等下游任务。

原文摘要 · Abstract (English)

Facial landmark localisation is a prerequisite for developing automated, non-contact neonatal pain assessment methods. Clinicians use pain scales to judge the severity of pain, many of which rely on facial expression. However, facial landmark detectors trained on adult faces perform poorly in neonatal clinical environments due to frequent occlusions caused by medical equipment, varied head poses, and challenging imaging conditions, including motion blur triggered by sudden pain-related movements. We propose an end-to-end facial landmark detector capable of predicting 68 landmarks on neonatal faces in clinical environments. We combined 37,459 single-face images from 11 public datasets, standardised to 68-point markup, with 1,123 manually annotated frames from a neonatal research dataset (totalling over 76,000 landmarks). A YOLO-based keypoint model was adapted to regress the facial landmarks, initialised with weights from a pretrained neonatal face detector. On public datasets, our proposed model achieved state-of-the-art performance: Normalised Mean Error (NME) = 5.37, Failure Rate (FR) = 12.5%, Area Under the Cumulative Error Curve (AUC) at AUC0.08 = 38.00% and AUC0.1 = 48.70%. On the clinical neonatal test set, before fine-tuning, the model achieved the lowest Detection Failure Rate (DFR) = 5.3% among all baselines and showed strong generalisation. After fine-tuning, performance improved further to NME = 6.36, FR = 22.30%, DFR = 1.77%, AUC0.08 = 29.24% and AUC0.1 = 40.25%. To the best of our knowledge, this represents the first end-to-end 68-point neonatal facial landmark detection model. With further dataset expansion and refinement, it could support downstream tasks in neonatal health monitoring and pain-related facial analysis.

面部识别新生儿医疗AI关键点检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。