用SAM生成可靠伪标签,提升无源医学图像分割的适应能力。
SRPL-SFDA: SAM-Guided Reliable Pseudo-Labels for Source-Free Domain Adaptation in Medical Image Segmentation
- 引入三通道增强与SAM结合,生成更高质量的伪标签。
- 通过多重输出一致性筛选可靠伪标签,抑制噪声。
- 可靠性感知训练使性能接近有监督方法,适合临床部署。
医学图像分割模型在新临床中心部署时面临显著域偏移问题,源无关域适应(SFDA)可解决源数据隐私与访问限制。但其在目标域缺乏标注,监督信号不足。本文提出基于SAM的可靠伪标签方法SRPL-SFDA,包含三个关键组件:1)测试时三分支强度增强(T3IE),提升目标域伪标签质量并生成三通道输入以适配SAM的零样本推理;2)基于多路SAM输出一致性的可靠伪标签筛选模块,在T3IE扰动下剔除低质量标签;3)可靠性感知训练策略,对可靠伪标签进行监督,不可靠区域通过熵最小化正则化。在胎儿大脑和前列腺两个多域医学图像分割数据集上的实验表明:1)该方法显著提升目标域伪标签质量,通过可靠性感知训练改善了SFDA性能;2)优于现有SOTA方法,性能接近目标域有监督训练水平。
原文摘要 · Abstract (English)
Domain Adaptation (DA) is crucial for robust deployment of medical image segmentation models when applied to new clinical centers with significant domain shifts. Source-Free Domain Adaptation (SFDA) is appealing as it can deal with privacy concerns and access constraints on source-domain data during adaptation to target-domain data. However, SFDA faces challenges such as insufficient supervision in the target domain with unlabeled images. In this work, we propose a Segment Anything Model (SAM)-guided Reliable Pseudo-Labels method for SFDA (SRPL-SFDA) with three key components: 1) Test-Time Tri-branch Intensity Enhancement (T3IE) that not only improves quality of raw pseudo-labels in the target domain, but also leads to SAM-compatible inputs with three channels to better leverage SAM's zero-shot inference ability for refining the pseudo-labels; 2) A reliable pseudo-label selection module that rejects low-quality pseudo-labels based on Consistency of Multiple SAM Outputs (CMSO) under input perturbations with T3IE; and 3) A reliability-aware training procedure in the unlabeled target domain where reliable pseudo-labels are used for supervision and unreliable parts are regularized by entropy minimization. Experiments conducted on two multi-domain medical image segmentation datasets for fetal brain and the prostate respectively demonstrate that: 1) SRPL-SFDA effectively enhances pseudo-label quality in the unlabeled target domain, and improves SFDA performance by leveraging the reliability-aware training; 2) SRPL-SFDA outperformed state-of-the-art SFDA methods, and its performance is close to that of supervised training in the target domain. The code of this work is available online: https://github.com/HiLab-git/SRPL-SFDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。