用AI实时追踪手术纱布,防遗留在患者体内。
Smart Operation Theatre: An AI-based System for Surgical Gauze Counting
- 用YOLOv5模型统一识别医护人员和纱布,提升效率。
- 准确追踪纱布进出,帧率从8提升至15FPS。
- 支持医生手动修正,适合临床实际使用。
手术中纱布遗留体内可能导致严重并发症(即'棉球瘤'),需通过影像诊断并二次手术取出,给患者与医院带来风险。传统预防手段如人工清点或射频标签存在效率低、易出错等问题。本文与新加坡中央医院合作,开发基于AI的手术纱布自动计数系统。利用实时视频监控与目标检测技术,采用YOLOv5模型,在标记为'进'和'出'的两个托盘上追踪纱布流动。系统通过11,000张来自手术室的真实图像训练,并进行数据增强,覆盖所有可能场景。相较之前分两模型(共2800张图)的方案,现采用集成模型同时检测人与纱布,精度提升,帧率由8 FPS提高至15 FPS。结合医生反馈,系统支持手动调整计数,显著提升临床可靠性。
原文摘要 · Abstract (English)
During surgeries, there is a risk of medical gauzes being left inside patients' bodies, leading to "Gossypiboma" in patients and can cause serious complications in patients and also lead to legal problems for hospitals from malpractice lawsuits and regulatory penalties. Diagnosis depends on imaging methods such as X-rays or CT scans, and the usual treatment involves surgical excision. Prevention methods, such as manual counts and RFID-integrated gauzes, aim to minimize gossypiboma risks. However, manual tallying of 100s of gauzes by nurses is time-consuming and diverts resources from patient care. In partnership with Singapore General Hospital (SGH) we have developed a new prevention method, an AI-based system for gauze counting in surgical settings. Utilizing real-time video surveillance and object recognition technology powered by YOLOv5, a Deep Learning model was designed to monitor gauzes on two designated trays labelled "In" and "Out". Gauzes are tracked from the "In" tray, prior to their use in the patient's body & in the "Out" tray post-use, ensuring accurate counting and verifying that no gauze remains inside the patient at the end of the surgery. We have trained it using numerous images from Operation Theatres & augmented it to satisfy all possible scenarios. This study has also addressed the shortcomings of previous project iterations. Previously, the project employed two models: one for human detection and another for gauze detection, trained on a total of 2800 images. Now we have an integrated model capable of identifying both humans and gauzes, using a training set of 11,000 images. This has led to improvements in accuracy and increased the frame rate from 8 FPS to 15 FPS now. Incorporating doctor's feedback, the system now also supports manual count adjustments, enhancing its reliability in actual surgeries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。