AI+语音控制让超声检查更准更快,医生可全程手不离探头。
Automating Sonologists USG Commands with AI and Voice Interface
- 用Mask R-CNN模型自动识别器官和关键点,减少人为误差。
- 肝纤维化检测准确率达98.6%,器官分割置信度50%~95%。
- 支持语音指令操作,提升临床效率,适合超声科医生使用。
本研究提出一种基于人工智能的超声成像系统,结合实时图像处理、器官追踪与语音指令,提升临床诊断的效率与准确性。传统超声检查耗时长且依赖操作者经验,易引入主观偏差。该系统利用计算机视觉与深度学习技术,采用Detectron2中的Mask R-CNN模型进行器官与关键解剖结构的语义分割,实现最小人工干预下的信息提取。同时集成语音识别功能,支持“冻结”“肝脏”等语音指令,实现免接触操作,使医生能专注患者。系统包含视频处理与实时分割模块,可自动完成图像冻结、放大等核心操作。肝组织病理模块在纤维化检测中达到98.6%的准确率;器官分割输出置信度区间为50%至95%,验证了其检测有效性。
原文摘要 · Abstract (English)
This research presents an advanced AI-powered ultrasound imaging system that incorporates real-time image processing, organ tracking, and voice commands to enhance the efficiency and accuracy of diagnoses in clinical practice. Traditional ultrasound diagnostics often require significant time and introduce a degree of subjectivity due to user interaction. The goal of this innovative solution is to provide Sonologists with a more predictable and productive imaging procedure utilizing artificial intelligence, computer vision, and voice technology. The functionality of the system employs computer vision and deep learning algorithms, specifically adopting the Mask R-CNN model from Detectron2 for semantic segmentation of organs and key landmarks. This automation improves diagnostic accuracy by enabling the extraction of valuable information with minimal human input. Additionally, it includes a voice recognition feature that allows for hands-free operation, enabling users to control the system with commands such as freeze or liver, all while maintaining their focus on the patient. The architecture comprises video processing and real-time segmentation modules that prepare the system to perform essential imaging functions, such as freezing and zooming in on frames. The liver histopathology module, optimized for detecting fibrosis, achieved an impressive accuracy of 98.6%. Furthermore, the organ segmentation module produces output confidence levels between 50% and 95%, demonstrating its efficacy in organ detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。