用双教师机制实现医学图像分割的自适应学习,提升小样本标注效果。
Dual Teacher-Student Learning for Semi-supervised Medical Image Segmentation
- 设计双教师系统,通过两组模型预测一致性生成伪标签。
- 在四个数据集上均超越现有方法,部分场景超全监督模型。
- 适合标注成本高的医疗图像分割任务,尤其标签极少时有效。
半监督学习可降低医学图像分割中人工标注的成本。主流方法为均值教师(MT)策略,利用时间平均教师模型进行一致性正则化。本文将MT重新诠释为监督学习中的自适应学习过程:教师预测与真实标签的一致性隐式引导模型从易到难学习。基于此洞察,提出双教师-学生学习(DTSL),通过两个信号调控未标注数据的学习节奏:一组内教师的时间平均信号,以及另一组不同架构学生的跨组信号。具体地,提出一种新型共识标签生成器(CLG),依据两信号的一致性生成伪标签,构建高效学习课程。在四个基准数据集上的大量实验表明,所提方法持续优于现有最先进方法。值得注意的是,在三个数据集中,仅使用少量标注数据的半监督方法性能超过其全监督对应模型,验证了自适应学习设计的有效性。
原文摘要 · Abstract (English)
Semi-supervised learning reduces the costly manual annotation burden in medical image segmentation. A popular approach is the mean teacher (MT) strategy, which applies consistency regularization using a temporally averaged teacher model. In this work, the MT strategy is reinterpreted as a form of self-paced learning in the context of supervised learning, where agreement between the teacher's predictions and the ground truth implicitly guides the model from easy to hard. Extending this insight to semi-supervised learning, we propose dual teacher-student learning (DTSL). It regulates the learning pace on unlabeled data using two signals: a temporally averaged signal from an in-group teacher and a cross-architectural signal from a student in a second, distinct model group. Specifically, a novel consensus label generator (CLG) creates the pseudo-labels from the agreement between these two signals, establishing an effective learning curriculum. Extensive experiments on four benchmark datasets demonstrate that the proposed method consistently outperforms existing state-of-the-art approaches. Remarkably, on three of the four datasets, our semi-supervised method with limited labeled data surpasses its fully supervised counterparts, validating the effectiveness of our self-paced learning design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。