融合CNN、ViT与边缘检测,提升医学图像分割边界精度
Rethinking Boundary Detection in Deep Learning-Based Medical Image Segmentation

- 设计双流编码器,分别捕捉局部特征与长程依赖
- 用边缘掩码显式指导解码,边界分割更精准
- 在7个数据集上达到顶尖性能,适合医疗图像分析场景
医学图像分割在医学影像分析与计算机视觉中至关重要。尽管现有方法在主要区域分割上表现良好,但边界区域的精确分割仍具挑战。本文提出新型网络架构CTO,结合卷积神经网络(CNN)、视觉变换器(ViT)与显式边缘检测算子以解决此问题。CTO遵循标准编码器-解码器结构,采用双流编码器:主干CNN流提取局部特征,辅助StitchViT流整合长程依赖。为增强边界学习能力,引入边界引导解码网络,利用专用边缘检测算子生成的二值边界掩码,在解码过程中提供显式指导。通过在七个具有挑战性的医学图像分割数据集(ISIC 2016、PH2、ISIC 2018、CoNIC、LiTS17、BTCV)上的广泛实验验证,结果表明CTO在各数据集上均达到当前最优分割精度,同时保持合理模型复杂度。
原文摘要 · Abstract (English)
Medical image segmentation is a pivotal task within the realms of medical image analysis and computer vision. While current methods have shown promise in accurately segmenting major regions of interest, the precise segmentation of boundary areas remains challenging. In this study, we propose a novel network architecture named CTO, which combines Convolutional Neural Networks (CNNs), Vision Transformer (ViT) models, and explicit edge detection operators to tackle this challenge. CTO surpasses existing methods in terms of segmentation accuracy and strikes a better balance between accuracy and efficiency, without the need for additional data inputs or label injections. Specifically, CTO adheres to the canonical encoder-decoder network paradigm, with a dual-stream encoder network comprising a mainstream CNN stream for capturing local features and an auxiliary StitchViT stream for integrating long-range dependencies. Furthermore, to enhance the model's ability to learn boundary areas, we introduce a boundary-guided decoder network that employs binary boundary masks generated by dedicated edge detection operators to provide explicit guidance during the decoding process. We validate the performance of CTO through extensive experiments conducted on seven challenging medical image segmentation datasets, namely ISIC 2016, PH2, ISIC 2018, CoNIC, LiTS17, and BTCV. Our experimental results unequivocally demonstrate that CTO achieves state-of-the-art accuracy on these datasets while maintaining competitive model complexity. The codes have been released at: https://github.com/xiaofang007/CTO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。