用少量涂鸦标注实现精准医学图像分割,提升弱监督学习效果。
ZScribbleSeg: A comprehensive segmentation framework with modeling of efficient annotation and maximization of scribble supervision

- 通过最大化涂鸦监督与随机模拟,设计高效标注形式。
- 融合空间关系与形状约束,在6个数据集上达到竞争力表现。
- 适合医疗图像分割中标注资源有限的场景,尤其擅长弱监督任务。
医学图像分割的全标注数据集构建耗时且依赖专业知识。为缓解此问题,已有研究采用涂鸦标注进行弱监督分割。现有方法主要在标注区域计算损失,并通过传播标注生成伪标签,但常因监督不足和形状信息不完整导致分割不准确。本文首次探究优质涂鸦标注的原则,通过最大化监督与随机性模拟实现高效涂鸦形式。进一步引入正则项编码空间关系与形状约束,利用期望最大化(EM)算法估计类别混合比例,以识别未标注像素并修正误判,为融合空间先验奠定基础。最终,将高效涂鸦监督与先验信息整合为ZScribbleSeg框架,应用于六项任务:ACDC、MSCMRseg、BTCV、MyoPS、Decathlon-BrainTumor 和 Decathlon-Prostate。仅依赖涂鸦标注,该方法在多个任务上取得具有竞争力的性能。代码将发布于 https://github.com/DLwbm123/ZScribbleSeg。
原文摘要 · Abstract (English)
Curating fully annotated datasets for medical image segmentation is labour-intensive and expertise-demanding. To alleviate this problem, prior studies have explored scribble annotations for weakly supervised segmentation. Existing solutions mainly compute losses on annotated areas and generate pseudo labels by propagating annotations to adjacent regions. However, these methods often suffer from inaccurate and unrealistic segmentations due to insufficient supervision and incomplete shape information. In contrast, we first investigate the principle of good scribble annotations, which leads to efficient scribble forms via supervision maximization and randomness simulation. We further introduce regularization terms to encode the spatial relationship and the shape constraints, where the EM algorithm is utilized to estimate the mixture ratios of label classes. These ratios are critical in identifying the unlabeled pixels for each class and correcting erroneous predictions, thus the accurate estimation lays the foundation for the incorporation of spatial prior. Finally, we integrate the efficient scribble supervision with the prior into a framework, referred to as ZScribbleSeg, and apply it to multiple scenarios. Leveraging only scribble annotations, ZScribbleSeg achieves competitive performance on six segmentation tasks including ACDC, MSCMRseg, BTCV, MyoPS, Decathlon-BrainTumor and Decathlon-Prostate. Our code will be released via https://github.com/DLwbm123/ZScribbleSeg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。