提出新模型精准分割手术场景中的解剖结构和器械,提升训练效果。
FASL-Seg: Anatomy and Tool Segmentation of Surgical Scenes
- 分两条路径分别处理高低层特征,兼顾细节与上下文信息。
- 在EndoVis18上达到72.71%的mIoU,比当前最优提升5%。
- 适合需要高精度手术场景理解的研究者与医疗AI开发者。
机器人微创手术日益普及,基于深度学习的手术训练成为研究重点。全面理解手术场景中的组件对实现精准分割至关重要,但现有工作多关注手术器械而忽略解剖结构。此外,当前最先进的模型难以平衡高层语义特征与低层边缘特征的捕捉。本文提出特征自适应空间定位模型(FASL-Seg),通过低层特征投影(LLFP)和高层特征投影(HLFP)两条独立处理流,针对不同特征分辨率进行多层级特征提取,从而实现解剖结构与手术器械的精确分割。我们在EndoVis17和EndoVis18两个基准数据集上评估了FASL-Seg在三个应用场景下的性能。结果表明,在EndoVis18的解剖结构与部件分割任务中,FASL-Seg的平均交并比(mIoU)达到72.71%,相比当前最优模型提升5%;在工具类型分割任务中,分别取得85.61%(EndoVis18)和72.78%(EndoVis17)的mIoU,整体表现优于现有方法,且在两类数据集上均保持各分类的高性能与一致性,验证了双路径设计对多尺度特征建模的有效性。
原文摘要 · Abstract (English)
The growing popularity of robotic minimally invasive surgeries has made deep learning-based surgical training a key area of research. A thorough understanding of the surgical scene components is crucial, which semantic segmentation models can help achieve. However, most existing work focuses on surgical tools and overlooks anatomical objects. Additionally, current state-of-the-art (SOTA) models struggle to balance capturing high-level contextual features and low-level edge features. We propose a Feature-Adaptive Spatial Localization model (FASL-Seg), designed to capture features at multiple levels of detail through two distinct processing streams, namely a Low-Level Feature Projection (LLFP) and a High-Level Feature Projection (HLFP) stream, for varying feature resolutions - enabling precise segmentation of anatomy and surgical instruments. We evaluated FASL-Seg on surgical segmentation benchmark datasets EndoVis18 and EndoVis17 on three use cases. The FASL-Seg model achieves a mean Intersection over Union (mIoU) of 72.71% on parts and anatomy segmentation in EndoVis18, improving on SOTA by 5%. It further achieves a mIoU of 85.61% and 72.78% in EndoVis18 and EndoVis17 tool type segmentation, respectively, outperforming SOTA overall performance, with comparable per-class SOTA results in both datasets and consistent performance in various classes for anatomy and instruments, demonstrating the effectiveness of distinct processing streams for varying feature resolutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。