arXiv:2501.15994eess.IVcs.CV2025-01被引 13

用YOLO11实现实时脑瘤超声检测,手术中秒级识别肿瘤位置。

Real-Time Brain Tumor Detection in Intraoperative Ultrasound Using YOLO11: From Model Training to Deployment in the Operating Room

  • 基于YOLO11架构,结合数据增强提升模型鲁棒性。
  • 测试集上mAP@50达0.95,每秒处理34.16帧图像。
  • 已在15例患者中验证,可无缝嵌入手术流程。

术中超声(ioUS)因其多功能性、低成本和易融入手术流程而成为脑瘤手术的重要工具,但其应用受限于图像解读难度和学习曲线陡峭。本研究旨在通过开发可在手术室部署的实时脑瘤检测系统来提升ioUS图像的可解释性。研究收集了来自Brain Tumor Intraoperative Database(BraTioUS)和公开的ReMIND数据集的2D ioUS图像,由专家精修标注肿瘤区域。采用YOLO11及其变体训练目标检测模型,数据集包含192名患者的1,732张图像,按比例划分为训练、验证和测试集,经数据增强后训练集扩大至11,570张。测试集中,YOLO11s在精度与计算效率间取得最佳平衡,mAP@50为0.95,mAP@50-95为0.65,处理速度达34.16帧/秒。该方案在15例连续脑瘤患者中前瞻性验证,神经外科医生确认其可无缝融入手术流程,实时预测准确勾画出肿瘤区域。结果表明,实时目标检测算法有望显著提升ioUS引导下的脑瘤手术效果,解决图像解读难题,为神经肿瘤手术中计算机视觉工具的发展奠定基础。

原文摘要 · Abstract (English)

Intraoperative ultrasound (ioUS) is a valuable tool in brain tumor surgery due to its versatility, affordability, and seamless integration into the surgical workflow. However, its adoption remains limited, primarily because of the challenges associated with image interpretation and the steep learning curve required for effective use. This study aimed to enhance the interpretability of ioUS images by developing a real-time brain tumor detection system deployable in the operating room. We collected 2D ioUS images from the Brain Tumor Intraoperative Database (BraTioUS) and the public ReMIND dataset, annotated with expert-refined tumor labels. Using the YOLO11 architecture and its variants, we trained object detection models to identify brain tumors. The dataset included 1,732 images from 192 patients, divided into training, validation, and test sets. Data augmentation expanded the training set to 11,570 images. In the test dataset, YOLO11s achieved the best balance of precision and computational efficiency, with a mAP@50 of 0.95, mAP@50-95 of 0.65, and a processing speed of 34.16 frames per second. The proposed solution was prospectively validated in a cohort of 15 consecutively operated patients diagnosed with brain tumors. Neurosurgeons confirmed its seamless integration into the surgical workflow, with real-time predictions accurately delineating tumor regions. These findings highlight the potential of real-time object detection algorithms to enhance ioUS-guided brain tumor surgery, addressing key challenges in interpretation and providing a foundation for future development of computer vision-based tools for neuro-oncological surgery.

脑瘤检测实时检测YOLO11术中超声

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。