arXiv:2603.00161cs.CVcs.LG2026-03

用手机实现五项眼科筛查,无需云端计算

SKINOPATHY AI: Smartphone-Based Ophthalmic Screening and Longitudinal Tracking Using Lightweight Computer Vision

  • 基于手机摄像头和本地算法,五项指标全在设备端完成
  • 可量化眼红、眨眼率、瞳孔反应等,精度达毫米级
  • 适合偏远地区初筛,保护隐私且无需专业医生

低资源与偏远地区的早期眼科筛查受限于专业设备和医护人员。我们提出SKINOPATHY AI,一款以智能手机为核心的Web应用,通过通用移动硬件实现五项互补且可解释的筛查模块:(1)基于LAB a*色彩空间归一化的红肿量化;(2)利用MediaPipe FaceMesh眼宽高比(EAR)与自适应阈值的眨眼率估计;(3)通过瞳孔-虹膜比(PIR)时序分析表征瞳孔光反射;(4)基于LAB/HSV统计的巩膜颜色索引,用于黄疸与贫血的间接判断;(5)基于虹膜地标校准的病灶侵入测量,提供毫米级估算及纵向趋势追踪。系统采用React/FastAPI架构,集成OpenCV与MediaPipe,依托MongoDB实现会话持久化,并支持PDF报告生成。所有算法均为确定性设计,保障隐私,专为非诊断性消费级分诊场景优化。文中详述系统架构、算法设计、评估方法、临床背景与伦理边界。SKINOPATHY AI证明,无需云端AI推理,仅靠未改装智能手机即可实现多信号眼科筛查,为未来临床验证的移动眼底检查工具奠定基础。

原文摘要 · Abstract (English)

Early ophthalmic screening in low-resource and remote settings is constrained by access to specialized equipment and trained practitioners. We present SKINOPATHY AI, a smartphone-first web application that delivers five complementary, explainable screening modules entirely through commodity mobile hardware: (1) redness quantification via LAB a* color-space normalization; (2) blink-rate estimation using MediaPipe FaceMesh Eye Aspect Ratio (EAR) with adaptive thresholding; (3) pupil light reflex characterization through Pupil-to-Iris Ratio (PIR) time-series analysis; (4) scleral color indexing foricterus and anemia proxies via LAB/HSV statistics; and (5) iris-landmark-calibrated lesion encroachment measurement with millimeter-scale estimates and longitudinal trend tracking. The system is implemented as a React/FastAPI stack with OpenCV and MediaPipe, MongoDB-backed session persistence, and PDF report generation. All algorithms are fully deterministic, privacy-preserving, and designed for non-diagnostic consumer triage. We detail system architecture, algorithm design, evaluation methodology, clinical context, and ethical boundaries of the platform. SKINOPATHY AI demonstrates that multi-signal ophthalmic screening is feasible on unmodified smartphones without cloud-based AI inference, providing a foundation for future clinically validated mobile ophthalmoscopy tools.

手机筛查眼科检测轻量模型隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。