无需预训练任务,用图结构监督实现极少量标注下的医学图像分割。
Affinity-Graph-Guided Contractive Learning for Pretext-Free Medical Image Segmentation with Minimal Annotation
- 构建师生网络间的亲和图监督信号,替代传统预训练任务。
- 仅用10%标注数据,分割精度接近全标注模型(误差2.52%)。
- 5%标注时性能超越第二名23.09%,适合标注稀缺的医疗场景。
半监督学习与对比学习的结合在有限标注的医学图像分割中已取得成功。然而,现有方法多依赖缺乏像素级分割特性的预训练任务,且因标注过少导致监督信号不足,易出现过拟合。为此,本文提出一种无预训练任务的半监督对比学习框架(Semi-AGCL),通过在学生与教师网络间建立基于亲和图的额外监督信号,实现极少量标注下的医学图像分割。该框架首先设计了一种基于平均块熵的块间采样方法,可在不依赖预训练任务的情况下提供稳健的初始特征空间;进一步设计亲和图引导的损失函数,利用数据内在结构提升表征质量与模型泛化能力,缓解过拟合问题。实验表明,仅使用完整标注集10%的数据时,模型性能接近全标注基线,误差仅为2.52%;在仅5%标注条件下,分割性能显著优于次优基线23.09%(Dice指标),并在极具挑战性的CRAG与ACDC数据集上分别提升26.57%。
原文摘要 · Abstract (English)
The combination of semi-supervised learning (SemiSL) and contrastive learning (CL) has been successful in medical image segmentation with limited annotations. However, these works often rely on pretext tasks that lack the specificity required for pixel-level segmentation, and still face overfitting issues due to insufficient supervision signals resulting from too few annotations. Therefore, this paper proposes an affinity-graph-guided semi-supervised contrastive learning framework (Semi-AGCL) by establishing additional affinity-graph-based supervision signals between the student and teacher network, to achieve medical image segmentation with minimal annotations without pretext. The framework first designs an average-patch-entropy-driven inter-patch sampling method, which can provide a robust initial feature space without relying on pretext tasks. Furthermore, the framework designs an affinity-graph-guided loss function, which can improve the quality of the learned representation and the model generalization ability by exploiting the inherent structure of the data, thus mitigating overfitting. Our experiments indicate that with merely 10% of the complete annotation set, our model approaches the accuracy of the fully annotated baseline, manifesting a marginal deviation of only 2.52%. Under the stringent conditions where only 5% of the annotations are employed, our model exhibits a significant enhancement in performance surpassing the second best baseline by 23.09% on the dice metric and achieving an improvement of 26.57% on the notably arduous CRAG and ACDC datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。