arXiv:2507.19592cs.CV2025-07

首个兼顾器械与部件的弱监督分割模型,提升手术机器人自动化精度

SurgPIS: Surgical-instrument-level Instances and Part-level Semantics for Weakly-supervised Part-aware Instance Segmentation

  • 用变压器架构+部件查询,统一处理器械实例与部件语义
  • 在仅有部分标注数据下仍实现领先性能,准确率超基准3.2%以上
  • 适合手术视觉分析、医疗机器人研发人员参考

一致的手术器械分割对机器人辅助手术自动化至关重要。现有方法仅单独处理器械级实例分割(IIS)或部件级语义分割(PSS),缺乏两者交互。本文提出首个手术器械统一的部件感知实例分割(PIS)框架SurgPIS,采用基于Transformer的掩码分类方法,通过从器械级目标查询中衍生出部件特定查询,显式关联部件与其所属器械实例。为应对缺乏同时具备实例与部件标注的大规模数据集的问题,我们设计弱监督学习策略,利用仅标注了IIS或PSS的不完整数据集进行训练。训练时将PIS预测聚合为IIS或PSS掩码,从而在部分标注数据上计算损失;并引入师生模型保持缺失信息(如仅含器械标签数据中的部件)预测一致性。多数据集实验验证其有效性,在PIS、IIS、PSS及器械语义分割任务上均达到当前最优表现。

原文摘要 · Abstract (English)

Consistent surgical instrument segmentation is critical for automation in robot-assisted surgery. Yet, existing methods only treat instrument-level instance segmentation (IIS) or part-level semantic segmentation (PSS) separately, without interaction between these tasks. In this work, we formulate a surgical tool segmentation as a unified part-aware instance segmentation (PIS) problem and introduce SurgPIS, the first PIS model for surgical instruments. Our method adopts a transformer-based mask classification approach and introduces part-specific queries derived from instrument-level object queries, explicitly linking parts to their parent instrument instances. In order to address the lack of large-scale datasets with both instance- and part-level labels, we propose a weakly-supervised learning strategy for SurgPIS to learn from disjoint datasets labelled for either IIS or PSS purposes. During training, we aggregate our PIS predictions into IIS or PSS masks, thereby allowing us to compute a loss against partially labelled datasets. A student-teacher approach is developed to maintain prediction consistency for missing PIS information in the partially labelled data, e.g., parts of the IIS labelled data. Extensive experiments across multiple datasets validate the effectiveness of SurgPIS, achieving state-of-the-art performance in PIS as well as IIS, PSS, and instrument-level semantic segmentation.

医学图像实例分割弱监督手术机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。