用自监督预训练,少95%标注也能精准分割肾小球。
Resource Efficient Multi-stain Kidney Glomeruli Segmentation via Self-supervision
- 通过自监督学习预训练模型,减少对标注数据依赖。
- 仅用5%标签时,分割准确率下降不足6%。
- 适合标注稀缺的病理图像分析场景。
在领域偏移下进行语义分割仍是计算机视觉中的根本挑战,尤其在标注数据稀缺的组织病理学图像分析中,同一组织结构需在不同染色条件(不同视觉领域)下进行分割。传统深度学习方法如UNet需要大量标注,成本高且耗时,尤其是面对多域(或多种染色)时。为此,已有无监督域适应方法(如UDAGAN)提出,仅需一个源染色的标注即可,但仍需获取源染色标注。本文表明,通过自监督预训练(包括SimCLR、BYOL及新方法HR-CS-CO),即使标注减少95%,分割性能仍可保持。特别地,在仅使用5%标注的情况下,UNet和UDAGAN的性能损失分别仅为5.9%和6.2%(所有染色类型平均),接近全监督表现。该结论在公开基准数据集上也具泛化性。代码与预训练模型已公开。
原文摘要 · Abstract (English)
Semantic segmentation under domain shift remains a fundamental challenge in computer vision, particularly when labelled training data is scarce. This challenge is particularly exemplified in histopathology image analysis, where the same tissue structures must be segmented across images captured under different imaging conditions (stains), each representing a distinct visual domain. Traditional deep learning methods like UNet require extensive labels, which is both costly and time-consuming, particularly when dealing with multiple domains (or stains). To mitigate this, various unsupervised domain adaptation based methods such as UDAGAN have been proposed, which reduce the need for labels by requiring only one (source) stain to be labelled. Nonetheless, obtaining source stain labels can still be challenging. This article shows that through self-supervised pre-training -- including SimCLR, BYOL, and a novel approach, HR-CS-CO -- the performance of these segmentation methods (UNet, and UDAGAN) can be retained even with 95% fewer labels. Notably, with self-supervised pre-training and using only 5% labels, the performance drops are minimal: 5.9% for UNet and 6.2% for UDAGAN, averaged over all stains, compared to their respective fully supervised counterparts (without pre-training, using 100% labels). Furthermore, these findings are shown to generalise beyond their training distribution to public benchmark datasets. Implementations and pre-trained models are publicly available \href{https://github.com/zeeshannisar/resource-effecient-multi-stain-kidney-glomeruli-segmentation.git}{online}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。