arXiv:2411.16794cs.CV2024-11被引 5

首个针对微创白内障手术的工具分割数据集与方法,提升小工具识别准确率。

Phase-Informed Tool Segmentation for Manual Small-Incision Cataract Surgery

  • 引入阶段条件解码器和伪标签半监督训练,增强工具分割性能。
  • 在3527帧上实现平均Dice分数提升23.77%至38.10%,小工具效果显著。
  • 适用于低资源地区手术分析,对医疗数字化有重要价值。

白内障手术是全球最常见的外科手术,但在发展中国家负担更重。尽管自动化手术视频分析已在普通外科中探索,但眼科手术应用仍有限。现有研究主要聚焦于昂贵的超声乳化白内障手术,而无法覆盖亟需治疗的地区。相比之下,手动小切口白内障手术(MSICS)是一种低成本、快速的替代方案,广泛用于高流量和复杂病例场景。然而,目前尚无针对MSICS的公开数据集。为此,我们提出Sankara-MSICS,首个涵盖53个手术视频、标注18个手术阶段、3527帧像素级工具标注的综合性数据集,涉及13种手术工具。我们在先进模型上对该数据集进行基准测试,并提出ToolSeg框架,通过引入阶段条件解码器和基于基础模型伪标签的简单有效半监督设置,显著提升工具分割性能,平均Dice分数提高23.77%至38.10%,尤其对少见且小尺寸工具提升明显。此外,我们验证了ToolSeg在CaDIS数据集上的泛化能力,证明其适用于其他外科场景。

原文摘要 · Abstract (English)

Cataract surgery is the most common surgical procedure globally, with a disproportionately higher burden in developing countries. While automated surgical video analysis has been explored in general surgery, its application to ophthalmic procedures remains limited. Existing works primarily focus on Phaco cataract surgery, an expensive technique not accessible in regions where cataract treatment is most needed. In contrast, Manual Small-Incision Cataract Surgery (MSICS) is the preferred low-cost, faster alternative in high-volume settings and for challenging cases. However, no dataset exists for MSICS. To address this gap, we introduce Sankara-MSICS, the first comprehensive dataset containing 53 surgical videos annotated for 18 surgical phases and 3,527 frames with 13 surgical tools at the pixel level. We benchmark this dataset on state-of-the-art models and present ToolSeg, a novel framework that enhances tool segmentation by introducing a phase-conditional decoder and a simple yet effective semi-supervised setup leveraging pseudo-labels from foundation models. Our approach significantly improves segmentation performance, achieving a $23.77\%$ to $38.10\%$ increase in mean Dice scores, with a notable boost for tools that are less prevalent and small. Furthermore, we demonstrate that ToolSeg generalizes to other surgical settings, showcasing its effectiveness on the CaDIS dataset.

手术分析工具分割医学影像半监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。