arXiv:2604.09151cs.CVnlin.PS2026-04

对比五种模型在手术器械分割中的表现,为医疗AI选型提供依据。

Benchmarking CNN- and Transformer-Based Models for Surgical Instrument Segmentation in Robotic-Assisted Surgery

  • 用复合损失函数优化模型,解决类别不平衡和边界模糊问题。
  • DeepLabV3与SegFormer表现接近,均优于传统CNN模型。
  • Transformer模型更擅长处理不同器械外观和手术条件的变化。

在机器人辅助手术中,准确分割手术器械对实现上下文感知的计算机辅助干预(如工具追踪、流程分析、自主决策)至关重要。本研究在SAR-RARP50数据集上,对五种深度学习架构——UNet、UNet、DeepLabV3、Attention UNet和SegFormer——进行多类语义分割的基准测试,用于真实根治性前列腺切除术视频中的手术器械分割。模型采用结合交叉熵与Dice损失的复合损失函数,以应对类别不平衡并捕捉精细物体边界。实验表明,尽管卷积模型如UNet和Attention UNet表现良好,但DeepLabV3的表现可与SegFormer相当,证明空洞卷积与多尺度上下文聚合在复杂手术场景中的有效性。基于Transformer的SegFormer进一步增强了全局上下文理解能力,提升了在不同器械外观和手术条件下的一般化性能。本研究提供了全面的模型比较与实用洞察,有助于在手术AI应用中选择合适的分割模型,揭示了卷积与Transformer方法之间的权衡。

原文摘要 · Abstract (English)

Accurate segmentation of surgical instruments in robotic-assisted surgery is critical for enabling context-aware computer-assisted interventions, such as tool tracking, workflow analysis, and autonomous decision-making. In this study, we benchmark five deep learning architectures-UNet, UNet, DeepLabV3, Attention UNet, and SegFormer on the SAR-RARP50 dataset for multi-class semantic segmentation of surgical instruments in real-world radical prostatectomy videos. The models are trained with a compound loss function combining Cross Entropy and Dice loss to address class imbalance and capture fine object boundaries. Our experiments reveal that while convolutional models such as UNet and Attention UNet provide strong baseline performance, DeepLabV3 achieves results comparable to SegFormer, demonstrating the effectiveness of atrous convolution and multi-scale context aggregation in capturing complex surgical scenes. Transformer-based architectures like SegFormer further enhance global contextual understanding, leading to improved generalization across varying instrument appearances and surgical conditions. This work provides a comprehensive comparison and practical insights for selecting segmentation models in surgical AI applications, highlighting the trade-offs between convolutional and transformer-based approaches.

手术分割深度学习注意力机制医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。