提出统一框架,解决医学图像分割中的标注少与域偏移问题。
Diverse Teaching and Label Propagation for Generic Semi-Supervised Medical Image Segmentation
- 双教师生成多样可靠伪标签,提升学生模型性能。
- 在5个基准数据集上均超越现有方法,跨任务表现优异。
- 适合医疗影像分割、域泛化等场景的科研与临床应用。
有限标注和域偏移是医学图像分割中的主要挑战,催生了半监督医学分割(SSMIS)、半监督医学域泛化(Semi-MDG)和无监督医学域适应(UMDA)等任务。传统方法针对单一任务设计,错误累积导致未标注数据利用不足,限制性能提升。本文提出通用框架DTLP-Net,包含一个学生模型和两个异构教师模型:首个教师分离有标签与无标签数据训练过程;第二个教师通过动量更新生成可靠且多样的伪标签。为充分利用数据信息,采用样本间与样本内数据增强以学习全局与局部知识,并引入标签传播机制捕捉体素级关联。在五个基准数据集上评估,涵盖SSMIS、UMDA与Semi-MDG任务,结果显著优于当前最优方法,验证了该框架应对复杂半监督场景的潜力。
原文摘要 · Abstract (English)
Both limited annotation and domain shift are significant challenges frequently encountered in medical image segmentation, leading to derivative scenarios like semi-supervised medical (SSMIS), semi-supervised medical domain generalization (Semi-MDG) and unsupervised medical domain adaptation (UMDA). Conventional methods are generally tailored to specific tasks in isolation, the error accumulation hinders the effective utilization of unlabeled data and limits further improvements, resulting in suboptimal performance when these issues occur. In this paper, we aim to develop a generic framework that masters all three tasks. We found that the key to solving the problem lies in how to generate reliable pseudo labels for the unlabeled data in the presence of domain shift with labeled data and increasing the diversity of the model. To tackle this issue, we employ a Diverse Teaching and Label Propagation Network (DTLP-Net) to boosting the Generic Semi-Supervised Medical Image Segmentation. Our DTLP-Net involves a single student model and two diverse teacher models, which can generate reliable pseudo-labels for the student model. The first teacher model decouple the training process with labeled and unlabeled data, The second teacher is momentum-updated periodically, thus generating reliable yet divers pseudo-labels. To fully utilize the information within the data, we adopt inter-sample and intra-sample data augmentation to learn the global and local knowledge. In addition, to further capture the voxel-level correlations, we propose label propagation to enhance the model robust. We evaluate our proposed framework on five benchmark datasets for SSMIS, UMDA, and Semi-MDG tasks. The results showcase notable improvements compared to state-of-the-art methods across all five settings, indicating the potential of our framework to tackle more challenging SSL scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。