用手机拍新生儿皮肤和眼白,3秒内无网检测黄疸严重程度
NeoJaundice-AI: Smartphone-Based Neonatal Jaundice Detection Using Dual-Input Deep Learning and Synthetic Augmentation
- 双路高效网络分别处理皮肤与眼白图像,融合颜色特征进行多任务分析
- 合成黄疸图像增强数据,对深肤色婴儿和重症病例识别准确率达91.8%
- 模型压缩至8.3MB,可在普通安卓手机离线运行,适合基层医疗使用
新生儿黄疸(高胆红素血症)是全球最常见的新生儿疾病之一,仅印度每年就约有1500万例。早期检测至关重要,但传统诊断依赖血液检测,在缺乏实验室的农村地区难以实施。本文提出NeoJaundice-AI,一种基于智能手机的筛查系统,通过拍摄婴儿皮肤和巩膜(眼白)照片,在不到三秒内无网络条件下估算黄疸严重程度并预测血清胆红素水平。该系统采用双分支EfficientNet-B0架构,独立处理皮肤与巩膜图像,深度特征结合手工提取的YCbCr颜色统计量,联合完成四分类严重程度判断与连续胆红素回归。核心贡献是提出一种合成黄疸生成方法,通过控制修改正常新生儿皮肤图像的YCbCr通道模拟胆红素引起的黄染,有效缓解数据稀缺问题,尤其针对深肤色(Fitzpatrick IV-VI型)及重症病例。此外,引入肤色归一化模块提升不同肤色调差异下的预测一致性。实验表明,分类准确率为91.8%,临床敏感度达93.5%,胆红素平均绝对误差为1.4 mg/dL。经INT8量化与ONNX转换后,模型大小降至8.3 MB,推理时间保持在三秒以内,可在标准安卓设备上部署。据我们所知,这是首个聚焦印度人群、集成多模态图像融合、肤色自适应、合成数据增强与全离线移动端部署的新生儿黄疸AI系统。
原文摘要 · Abstract (English)
Neonatal jaundice (hyperbilirubinemia) is one of the most common conditions affecting newborns worldwide, with India alone recording roughly 15 million cases per year. Early detection is critical, yet standard diagnosis requires blood tests that are often impractical in rural clinics where laboratory facilities are limited. This paper presents NeoJaundice-AI, a smartphone-based screening system that uses photographs of a baby's skin and sclera (eye white) to estimate jaundice severity and predict serum bilirubin levels in under three seconds without requiring internet connectivity. The proposed system is built on a dual-branch EfficientNet-B0 architecture that independently processes skin and sclera images. Deep features are fused with handcrafted YCbCr color statistics to jointly perform four-class severity classification and continuous bilirubin regression. A key contribution is a synthetic jaundice generation method that simulates bilirubin-induced yellowing through controlled YCbCr channel modifications on normal neonatal skin images. This approach addresses data scarcity, particularly for severe jaundice cases and darker Indian skin tones (Fitzpatrick Types IV to VI). In addition, a skin-tone normalization module improves prediction consistency across diverse neonatal complexions. Experimental results demonstrate an overall classification accuracy of 91.8 percent, a clinical sensitivity of 93.5 percent, and a bilirubin mean absolute error of 1.4 mg/dL. After INT8 quantization and ONNX conversion, the model size is reduced to 8.3 MB while maintaining inference times below three seconds on standard Android devices. To the best of our knowledge, this is the first India-focused neonatal jaundice AI system that combines multimodal image fusion, skin-tone adaptation, synthetic data augmentation, and fully offline mobile deployment within a single framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。