仅用一张标注切片实现3D医学图像精准分割,解决误差累积和断层问题。
Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network
- 通过物体估计引导的对应流网络,自监督学习切片间可靠对应关系。
- 单张标注切片即可完成整体积分割,跨器官、模态表现更优。
- 适合标注数据稀缺场景,尤其适用于多中心、小样本医学影像研究。
深度学习在医学图像分割中取得显著进展,但需大量标注数据。为降低标注负担,已有方法如Sli2Vol提出自监督框架(SSF),通过相邻切片重建学习对应关系,并在测试阶段传播标签。然而,这类方法易因切片间误差传递导致误差累积,且对连续切片间的断层处理不佳。为此,本文提出新自监督框架 extit{Sli2Vol+},仅需每体积一张标注切片即可实现3D分割。训练时,先将标注切片传播至其他切片生成伪标签(PLs),再利用新型物体估计引导的对应流网络,在自监督下学习切片与伪标签间的可靠对应关系;测试时,利用该对应关系将单张标注切片传播至整个测试体积。实验表明,该方法在多种数据集上表现优异,具备跨器官、跨模态的强泛化能力。代码已公开于https://github.com/adlsn/Sli2Volplus。
原文摘要 · Abstract (English)
Deep learning (DL) methods have shown remarkable successes in medical image segmentation, often using large amounts of annotated data for model training. However, acquiring a large number of diverse labeled 3D medical image datasets is highly difficult and expensive. Recently, mask propagation DL methods were developed to reduce the annotation burden on 3D medical images. For example, Sli2Vol~\cite{yeung2021sli2vol} proposed a self-supervised framework (SSF) to learn correspondences by matching neighboring slices via slice reconstruction in the training stage; the learned correspondences were then used to propagate a labeled slice to other slices in the test stage. But, these methods are still prone to error accumulation due to the inter-slice propagation of reconstruction errors. Also, they do not handle discontinuities well, which can occur between consecutive slices in 3D images, as they emphasize exploiting object continuity. To address these challenges, in this work, we propose a new SSF, called \proposed, {for segmenting any anatomical structures in 3D medical images using only a single annotated slice per training and testing volume.} Specifically, in the training stage, we first propagate an annotated 2D slice of a training volume to the other slices, generating pseudo-labels (PLs). Then, we develop a novel Object Estimation Guided Correspondence Flow Network to learn reliable correspondences between consecutive slices and corresponding PLs in a self-supervised manner. In the test stage, such correspondences are utilized to propagate a single annotated slice to the other slices of a test volume. We demonstrate the effectiveness of our method on various medical image segmentation tasks with different datasets, showing better generalizability across different organs, modalities, and modals. Code is available at \url{https://github.com/adlsn/Sli2Volplus}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。