无需像素标注,通过对比学习实现高效医学图像分割。
Domain and Task-Focused Example Selection for Data-Efficient Contrastive Medical Image Segmentation
- 利用图像间内在关系构建代理任务,自监督学习上下文感知特征。
- 在低数据和跨域场景下均超越全监督与自监督基线方法。
- 结合SAM进行后处理优化和2D到3D传播,适合医疗影像少样本学习。
医学图像分割是影响诸多影像决策的关键任务。全监督分割需大量人工标注数据,但像素级标注成本高、耗时长且易出错,限制了模型在有限标注数据下的学习效率。为此,本文提出一种新颖的自监督对比学习框架PolyCL,无需像素级标注或不合理的数据增强,通过创新的代理任务,以任务相关方式从无标签数据中学习并迁移对分割有用的上下文感知判别特征。同时,将分割任意模型(SAM)以两种新方式集成:作为后处理精修模块,利用粗略输出生成的边界框提示改进预测掩码精度;作为传播机制,通过SAM 2从单个标注的2D切片生成体积分割。在三个公开的计算机断层扫描(CT)数据集上的实验表明,PolyCL在低数据和跨域场景下均优于全监督与自监督基线方法。代码已开源:https://github.com/tbwa233/PolyCL。
原文摘要 · Abstract (English)
Segmentation is one of the most important tasks in the medical imaging pipeline as it influences a number of image-based decisions. To be effective, fully supervised segmentation approaches require large amounts of manually annotated training data. However, the pixel-level annotation process is expensive, time-consuming, and error-prone, hindering progress and making it challenging to perform effective segmentations. Therefore, models must learn efficiently from limited labeled data. Self-supervised learning (SSL), particularly contrastive learning via pre-training on unlabeled data and fine-tuning on limited annotations, can facilitate such limited labeled image segmentation. To this end, we propose a novel self-supervised contrastive learning framework for medical image segmentation, leveraging inherent relationships of different images, dubbed PolyCL. Without requiring any pixel-level annotations or unreasonable data augmentations, our PolyCL learns and transfers context-aware discriminant features useful for segmentation from an innovative surrogate, in a task-related manner. Additionally, we integrate the Segment Anything Model (SAM) into our framework in two novel ways: as a post-processing refinement module that improves the accuracy of predicted masks using bounding box prompts derived from coarse outputs, and as a propagation mechanism via SAM 2 that generates volumetric segmentations from a single annotated 2D slice. Experimental evaluations on three public computed tomography (CT) datasets demonstrate that PolyCL outperforms fully-supervised and self-supervised baselines in both low-data and cross-domain scenarios. Our code is available at https://github.com/tbwa233/PolyCL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。