arXiv:2409.06928cs.CVcs.AI2024-09被引 17

用双学生-教师框架提升产科超声中耻骨联合与胎儿头部分割精度

Intrapartum Ultrasound Image Segmentation of Pubic Symphysis and Fetal Head Using Dual Student-Teacher Framework with CNN-ViT Collaborative Learning

  • 融合CNN与Transformer的双学生-教师架构,通过硬/软伪标签实现互监督
  • 在MICCAI 2023基准数据集上达到最优性能,显著优于10种现有半监督方法
  • 适用于标注数据稀缺的医学图像分割场景,尤其适合产科超声分析

耻骨联合与胎儿头部(PSFH)的分割是监测分娩进程和识别潜在分娩并发症的关键步骤。尽管深度学习取得进展,但医学图像标注数据的缺乏限制了分割模型的训练。传统半监督学习方法多采用基于卷积神经网络(CNN)的统一网络模型,并施加一致性正则化以减少对大量标注数据的依赖。然而,这些方法在捕捉未标注数据的判别特征以及建模超声图像中模糊边界所蕴含的长程依赖关系方面表现不足。为此,我们提出一种新框架——结合CNN与Transformer的双学生-教师(DSTCT)框架,该框架包含一个视觉变换器(ViT)作为教师,以及两个学生模型:一个ViT和一个CNN。双学生结构通过生成硬伪标签和软伪标签实现相互监督,同时通过最小化分类器确定性差异来优化预测一致性。教师模型进一步通过施加一致性正则化约束强化学习。为增强模型泛化能力,我们引入数据与模型扰动相结合的技术。在MICCAI 2023 PSFH分割挑战赛的基准数据集上的全面评估表明,DSTCT框架优于10种现有的半监督分割方法。代码已开源:https://github.com/jjm1589/DSTCT。

原文摘要 · Abstract (English)

The segmentation of the pubic symphysis and fetal head (PSFH) constitutes a pivotal step in monitoring labor progression and identifying potential delivery complications. Despite the advances in deep learning, the lack of annotated medical images hinders the training of segmentation. Traditional semi-supervised learning approaches primarily utilize a unified network model based on Convolutional Neural Networks (CNNs) and apply consistency regularization to mitigate the reliance on extensive annotated data. However, these methods often fall short in capturing the discriminative features of unlabeled data and in delineating the long-range dependencies inherent in the ambiguous boundaries of PSFH within ultrasound images. To address these limitations, we introduce a novel framework, the Dual-Student and Teacher Combining CNN and Transformer (DSTCT), which synergistically integrates the capabilities of CNNs and Transformers. Our framework comprises a Vision Transformer (ViT) as the teacher and two student mod ls one ViT and one CNN. This dual-student setup enables mutual supervision through the generation of both hard and soft pseudo-labels, with the consistency in their predictions being refined by minimizing the classifier determinacy discrepancy. The teacher model further reinforces learning within this architecture through the imposition of consistency regularization constraints. To augment the generalization abilities of our approach, we employ a blend of data and model perturbation techniques. Comprehensive evaluations on the benchmark dataset of the PSFH Segmentation Grand Challenge at MICCAI 2023 demonstrate our DSTCT framework outperformed ten contemporary semi-supervised segmentation methods. Code available at https://github.com/jjm1589/DSTCT.

医学图像分割半监督学习双学生教师超声分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。