解决医学影像分割中标签少且跨域差异大的难题,提升模型泛化能力。
Unleashing the Power of Intermediate Domains for Mixed Domain Semi-Supervised Medical Image Segmentation
- 构建中间域数据,通过伪标签融合增强知识迁移。
- 在前列腺数据集上实现Dice分数12.94%的提升。
- 适合医疗影像跨域分割任务,尤其标签稀缺场景。
医学图像分割面临标注数据有限和域偏移的双重挑战。传统半监督分割与无监督域适应方法仅分别应对其中一类问题。为应对二者共存的实际场景,本文提出混合域半监督医学图像分割(MiDSS)新范式:单域少量标注数据与多域大量未标注数据并存。为此,我们提出UST-RUN框架,充分挖掘中间域信息以促进知识迁移。采用统一复制粘贴(UCP)构建中间域,并设计对称引导训练策略(SymGD),通过融合中间样本的伪标签来监督未标注数据。进一步引入训练过程感知随机幅度混合法(TP-RAM),逐步将风格转换成分融入中间样本。为生成更丰富的中间样本,筛选高质量伪标签的可靠样本,并与其它未标注数据混合;同时为不可靠样本生成高质量伪标签的复杂中间样本,确保有效知识传递。在四个公开数据集上的实验表明,该方法显著优于现有方法,尤其在前列腺数据集上,Dice分数提升达12.94%。代码已开源。
原文摘要 · Abstract (English)
Both limited annotation and domain shift are prevalent challenges in medical image segmentation. Traditional semi-supervised segmentation and unsupervised domain adaptation methods address one of these issues separately. However, the coexistence of limited annotation and domain shift is quite common, which motivates us to introduce a novel and challenging scenario: Mixed Domain Semi-supervised medical image Segmentation (MiDSS), where limited labeled data from a single domain and a large amount of unlabeled data from multiple domains. To tackle this issue, we propose the UST-RUN framework, which fully leverages intermediate domain information to facilitate knowledge transfer. We employ Unified Copy-paste (UCP) to construct intermediate domains, and propose a Symmetric GuiDance training strategy (SymGD) to supervise unlabeled data by merging pseudo-labels from intermediate samples. Subsequently, we introduce a Training Process aware Random Amplitude MixUp (TP-RAM) to progressively incorporate style-transition components into intermediate samples. To generate more diverse intermediate samples, we further select reliable samples with high-quality pseudo-labels, which are then mixed with other unlabeled data. Additionally, we generate sophisticated intermediate samples with high-quality pseudo-labels for unreliable samples, ensuring effective knowledge transfer for them. Extensive experiments on four public datasets demonstrate the superiority of UST-RUN. Notably, UST-RUN achieves a 12.94% improvement in Dice score on the Prostate dataset. Our code is available at https://github.com/MQinghe/UST-RUN
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。