用合成图像匹配伪标签,解决医学影像分割标注少的问题
SynMatch: Rethinking Consistency in Medical Image Segmentation with Sparse Annotations
- 通过同步生成图像与伪标签,避免伪标签不一致问题
- 在5%和10%标注下,比现有方法提升29.71%和10.05%
- 适合标注极少的医学图像分割任务,如肠镜息肉分割
标注稀缺仍是深度学习医学图像分割的主要挑战。现有研究采用强-弱伪监督来利用未标注数据,但伪标签与对应图像之间的不一致性常导致性能下降。本文提出SynMatch框架,通过合成图像来匹配伪标签,而非改进伪标签本身。具体地,利用生成伪标签的同一分割模型提取的纹理与形状特征,合成与之高度一致的图像。该设计无需图像合成的训练参数即可生成高一致性合成图像-伪标签对。我们在半监督(SSL)、弱监督(WSL)和极少量监督(BSL)设置下,跨多种医学图像分割任务进行广泛评估。结果表明,SynMatch表现优异,尤其在最具挑战性的BSL设置中。例如,在仅5%和10%涂鸦标注的息肉分割任务中,相比近期基于强-弱伪监督的方法,分别提升29.71%和10.05%。代码将发布于https://github.com/Senyh/SynMatch。
原文摘要 · Abstract (English)
Label scarcity remains a major challenge in deep learning-based medical image segmentation. Recent studies use strong-weak pseudo supervision to leverage unlabeled data. However, performance is often hindered by inconsistencies between pseudo labels and their corresponding unlabeled images. In this work, we propose \textbf{SynMatch}, a novel framework that sidesteps the need for improving pseudo labels by synthesizing images to match them instead. Specifically, SynMatch synthesizes images using texture and shape features extracted from the same segmentation model that generates the corresponding pseudo labels for unlabeled images. This design enables the generation of highly consistent synthesized-image-pseudo-label pairs without requiring any training parameters for image synthesis. We extensively evaluate SynMatch across diverse medical image segmentation tasks under semi-supervised learning (SSL), weakly-supervised learning (WSL), and barely-supervised learning (BSL) settings with increasingly limited annotations. The results demonstrate that SynMatch achieves superior performance, especially in the most challenging BSL setting. For example, it outperforms the recent strong-weak pseudo supervision-based method by 29.71\% and 10.05\% on the polyp segmentation task with 5\% and 10\% scribble annotations, respectively. The code will be released at https://github.com/Senyh/SynMatch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。