arXiv:2511.23355cs.CV2025-11

用摄像头识别监护仪屏幕数据,让旧设备也能连上电子病历系统。

A Hierarchical Computer Vision Pipeline for Physiological Data Extraction from Bedside Monitors

  • 分层视觉流程:先定位屏幕和关键区域,再矫正视角后提取文字。
  • 在6498张图像上,核心生命体征识别准确率超98.9%。
  • 适合资源有限医院,无需换设备就能数字化监护数据。

在许多资源匮乏的医疗环境中,床旁监护仪仍是无网络连接的独立设备,导致生理数据无法无缝集成到电子健康记录(EHR)系统中。为解决这一问题且不需昂贵硬件更换,我们提出一种基于计算机视觉的流水线,可自动捕获并数字化监护仪屏幕上的生命体征数据。方法采用分层检测框架,结合YOLOv11进行监护仪与感兴趣区域(ROI)精准定位,以及PaddleOCR实现鲁棒文本提取。为提升在不同相机角度和光照条件下的可靠性,引入几何校正模块以标准化屏幕透视。在来自开源语料库及越南真实重症监护室采集的6,498张图像上评估,监控器检测mAP@50-95达99.5%,生命体征ROI定位达91.5%。端到端数据提取准确率超过98.9%,涵盖心率、血氧饱和度SpO2和动脉血压等核心参数。结果表明,轻量级摄像头方案能可靠地将屏幕上的非结构化信息转化为结构化数字数据,为低资源环境下提升信息可及性与临床记录效率提供可行且可扩展的路径。

原文摘要 · Abstract (English)

In many low-resource healthcare settings, bedside monitors remain standalone legacy devices without network connectivity, creating a persistent interoperability gap that prevents seamless integration of physiological data into electronic health record (EHR) systems. To address this challenge without requiring costly hardware replacement, we present a computer vision-based pipeline for the automated capture and digitisation of vital sign data directly from bedside monitor screens. Our method employs a hierarchical detection framework combining YOLOv11 for accurate monitor and region of interest (ROI) localisation with PaddleOCR for robust text extraction. To enhance reliability across variable camera angles and lighting conditions, a geometric rectification module standardizes the screen perspective before character recognition. We evaluated the system on a dataset of 6,498 images collected from open-source corpora and real-world intensive care units in Vietnam. The model achieved a mean Average Precision (mAP@50-95) of 99.5% for monitor detection and 91.5% for vital sign ROI localisation. The end-to-end extraction accuracy exceeded 98.9% for core physiological parameters, including heart rate, oxygen saturation SpO2, and arterial blood pressure. These results demonstrate that a lightweight, camera-based approach can reliably transform unstructured information from screen captures into structured digital data, providing a practical and scalable pathway to improve information accessibility and clinical documentation in low-resource settings.

计算机视觉医疗数据监护仪自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。