arXiv:2409.18100cs.CVcs.LG2024-09中稿 · Data Engineering i…

自监督预训练在少量标注数据下提升心脏核磁分割效果

Self-supervised Pretraining for Cardiovascular Magnetic Resonance Cine Segmentation

  • 用四种自监督方法在无标签数据上预训练,再微调分割模型
  • 仅10个病人数据时,掩码图像建模法使分割准确率提升至0.86
  • 大量标注数据下,预训练不再带来优势,选择方法很关键

自监督预训练(SSP)在利用大规模无标签数据学习方面展现出潜力,可能有助于心血管磁共振(CMR)短轴动态电影序列的自动分割。然而,关于其对分割任务是否有益的报告不一,限制了其在CMR中的应用。本研究评估了四种SSP方法在CMR cine分割中的表现:SimCLR、位置对比学习、DINO和掩码图像建模(MIM)。使用296名受试者(共90,618张2D切片)进行无标签预训练,随后在不同数量的受试者子集上进行有监督微调,同时训练一个从头开始的2D基线模型。在140名受试者的测试集上,以3D Dice相似系数(DSC)评估性能。结果显示,在最大微调子集下,各SSP方法均未超越基线(DSC = 0.89)。当仅使用10名受试者(231张2D切片)进行微调时,使用MIM的SSP模型达到DSC = 0.86,优于从头训练的DSC = 0.82。研究发现,当标注数据稀缺时,SSP对CMR cine分割有价值;但在大量标注数据下,其无法提升现有深度学习方法的表现。此外,所选的SSP方法至关重要。代码已公开:https://github.com/q-cardIA/ssp-cmr-cine-segmentation

原文摘要 · Abstract (English)

Self-supervised pretraining (SSP) has shown promising results in learning from large unlabeled datasets and, thus, could be useful for automated cardiovascular magnetic resonance (CMR) short-axis cine segmentation. However, inconsistent reports of the benefits of SSP for segmentation have made it difficult to apply SSP to CMR. Therefore, this study aimed to evaluate SSP methods for CMR cine segmentation. To this end, short-axis cine stacks of 296 subjects (90618 2D slices) were used for unlabeled pretraining with four SSP methods; SimCLR, positional contrastive learning, DINO, and masked image modeling (MIM). Subsets of varying numbers of subjects were used for supervised fine-tuning of 2D models for each SSP method, as well as to train a 2D baseline model from scratch. The fine-tuned models were compared to the baseline using the 3D Dice similarity coefficient (DSC) in a test dataset of 140 subjects. The SSP methods showed no performance gains with the largest supervised fine-tuning subset compared to the baseline (DSC = 0.89). When only 10 subjects (231 2D slices) are available for supervised training, SSP using MIM (DSC = 0.86) improves over training from scratch (DSC = 0.82). This study found that SSP is valuable for CMR cine segmentation when labeled training data is scarce, but does not aid state-of-the-art deep learning methods when ample labeled data is available. Moreover, the choice of SSP method is important. The code is publicly available at: https://github.com/q-cardIA/ssp-cmr-cine-segmentation

自监督学习医学影像心脏分割小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。