用一致性训练提升医学图像分割,不依赖额外模型解决类别不平衡问题。
Exploiting Unlabeled Structures through Task Consistency Training for Versatile Medical Image Segmentation
- 通过主干网络与辅助任务头间的一致性约束,利用未标注结构信息。
- 在8个腹部数据集上实现优于现有方法的分割精度,尤其改善少数类表现。
- 适合处理标注不均衡的医疗影像场景,对临床实用性强。
通用医学图像分割(VMIS)旨在分割多种解剖结构,但全量标注因耗时耗力难以实现。利用部分标注数据集(PLD)是可行替代方案,但现有方法常因类别分布不均导致严重类别不平衡。当前方法通过生成伪全标签缓解此问题,但需额外模型且易受标签噪声影响。本文提出任务一致性训练(TCT)框架,无需额外模型即可缓解类别不平衡。TCT包含一个主分割头(MSH)和多个辅助任务头(ATH),通过强制MSH与ATH预测保持一致,有效利用未标注结构。为防止低一致性数据带来的误差传播,设计过滤策略剔除此类样本。同时引入统一的辅助不确定性加权损失(UAUWL),减轻特定任务主导导致的分割质量下降。在来自不同临床机构的8个腹部数据集上进行大量实验,验证了该方法的有效性。
原文摘要 · Abstract (English)
Versatile medical image segmentation (VMIS) targets the segmentation of multiple classes, while obtaining full annotations for all classes is often impractical due to the time and labor required. Leveraging partially labeled datasets (PLDs) presents a promising alternative; however, current VMIS approaches face significant class imbalance due to the unequal category distribution in PLDs. Existing methods attempt to address this by generating pseudo-full labels. Nevertheless, these typically require additional models and often result in potential performance degradation from label noise. In this work, we introduce a Task Consistency Training (TCT) framework to address class imbalance without requiring extra models. TCT includes a backbone network with a main segmentation head (MSH) for multi-channel predictions and multiple auxiliary task heads (ATHs) for task-specific predictions. By enforcing a consistency constraint between the MSH and ATH predictions, TCT effectively utilizes unlabeled anatomical structures. To avoid error propagation from low-consistency, potentially noisy data, we propose a filtering strategy to exclude such data. Additionally, we introduce a unified auxiliary uncertainty-weighted loss (UAUWL) to mitigate segmentation quality declines caused by the dominance of specific tasks. Extensive experiments on eight abdominal datasets from diverse clinical sites demonstrate our approach's effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。