用超像素引导对比学习,提升医学图像分割预训练效果
SuperCL: Superpixel Guided Contrastive Learning for Medical Image Segmentation Pre-training
- 引入超像素生成图像内局部与跨图像全局对比对
- 在10%标注数据下,三项指标分别提升3.15%~7.89%
- 适合医学图像分割领域研究者使用
医学图像分割面临高质量标注数据稀缺的挑战。现有对比学习方法多关注实例级或像素级表示,忽视图像内部相似像素群的特性;且对比对生成依赖人工设定阈值,效率低、泛化差。为此,我们提出SuperCL,一种用于医学图像分割预训练的新颖对比学习方法。通过超像素图生成伪掩码,构建图像内局部对比对(ILCP)和跨图像全局对比对(IGCP),并引入平均超像素特征图生成(ASP)与连通域标签生成(CCL)模块,增强结构先验利用。在8个医学图像数据集上的实验表明,SuperCL优于12种现有方法。在仅10%标注数据下,于MMWHS、CHAOS、Spleen数据集上分别实现3.15%、5.44%、7.89%的DSC提升,可视化结果更精准。
原文摘要 · Abstract (English)
Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic solution to this issue. Because most existing methods focus on extracting instance-level or pixel-to-pixel representation, which ignores the characteristics between intra-image similar pixel groups. Moreover, when considering contrastive pairs generation, most SOTA methods mainly rely on manually setting thresholds, which requires a large number of gradient experiments and lacks efficiency and generalization. To address these issues, we propose a novel contrastive learning approach named SuperCL for medical image segmentation pre-training. Specifically, our SuperCL exploits the structural prior and pixel correlation of images by introducing two novel contrastive pairs generation strategies: Intra-image Local Contrastive Pairs (ILCP) Generation and Inter-image Global Contrastive Pairs (IGCP) Generation. Considering superpixel cluster aligns well with the concept of contrastive pairs generation, we utilize the superpixel map to generate pseudo masks for both ILCP and IGCP to guide supervised contrastive learning. Moreover, we also propose two modules named Average SuperPixel Feature Map Generation (ASP) and Connected Components Label Generation (CCL) to better exploit the prior structural information for IGCP. Finally, experiments on 8 medical image datasets indicate our SuperCL outperforms existing 12 methods. i.e. Our SuperCL achieves a superior performance with more precise predictions from visualization figures and 3.15%, 5.44%, 7.89% DSC higher than the previous best results on MMWHS, CHAOS, Spleen with 10% annotations. Our code will be released after acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。