arXiv:2411.03695cs.CV2024-11中稿 · the 2025 IEEE/CVF …被引 3

无需伪标签,通过图割损失实现更鲁棒的无监督手术器械分割

AMNCutter: Affinity-Attention-Guided Multi-View Normalized Cutter for Unsupervised Surgical Instrument Segmentation

  • 基于补丁亲和力设计图割损失,替代传统伪标签
  • 在多个数据集上达到当前最优性能,泛化能力更强
  • 适合缺乏标注数据的手术视频分析场景

手术器械分割(SIS)对机器人辅助微创手术至关重要,可帮助外科医生识别内窥镜视频帧中的手术器械。现有无监督手术器械分割(USIS)方法主要依赖颜色和光流等低层特征生成伪标签,但在复杂或未见的内窥镜场景中表现有限。本文提出一种无需标签的无监督模型,引入新型模块多视角归一化切分器(m-NCutter)。与以往方法不同,该模型使用基于补丁亲和力的图割损失进行训练,无需伪标签。框架自适应选择各层级亲和力的优先级,有效融合高低层特征及其亲和力,实现无标签训练。在多个SIS数据集上进行充分实验,验证了本方法在性能、鲁棒性及作为预训练模型潜力方面的先进性。代码已公开于https://github.com/MingyuShengSMY/AMNCutter。

原文摘要 · Abstract (English)

Surgical instrument segmentation (SIS) is pivotal for robotic-assisted minimally invasive surgery, assisting surgeons by identifying surgical instruments in endoscopic video frames. Recent unsupervised surgical instrument segmentation (USIS) methods primarily rely on pseudo-labels derived from low-level features such as color and optical flow, but these methods show limited effectiveness and generalizability in complex and unseen endoscopic scenarios. In this work, we propose a label-free unsupervised model featuring a novel module named Multi-View Normalized Cutter (m-NCutter). Different from previous USIS works, our model is trained using a graph-cutting loss function that leverages patch affinities for supervision, eliminating the need for pseudo-labels. The framework adaptively determines which affinities from which levels should be prioritized. Therefore, the low- and high-level features and their affinities are effectively integrated to train a label-free unsupervised model, showing superior effectiveness and generalization ability. We conduct comprehensive experiments across multiple SIS datasets to validate our approach's state-of-the-art (SOTA) performance, robustness, and exceptional potential as a pre-trained model. Our code is released at https://github.com/MingyuShengSMY/AMNCutter.

无监督学习医学图像分割手术辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。