arXiv:2606.21605cs.CV2026-06

用基础模型实现电子显微镜图像少样本分割,大幅减少标注需求。

$μ$Match: Foundation Models for Semi-supervised Learning and Domain Adaptation in EM

论文配图:$μ$Match: Foundation Models for Semi-supervised Learning and Domain Adaptation in EM
图 1 · 摘自论文原文
  • 基于学生-教师框架,融合多种基础模型进行半监督学习。
  • 在线粒体、细胞核等任务上超越强基线,提升分割精度。
  • 适合需要降低标注成本的生物医学图像分析研究者。

视觉基础模型显著推进了计算机视觉,在零样本和少样本设置下取得顶尖性能,已成功应用于从CT器官分割到光显微镜细胞分割的生物医学成像任务。电子显微镜(EM)因其纳米级分辨率,是分析细胞超微结构的核心模态。然而,基础模型在EM中的应用仍局限于特定细胞器(如线粒体),主要受限于分割任务多样性及全面标注数据稀缺。因此,EM分割仍以监督学习为主,依赖大量人工标注,限制了超微结构分析。为此,我们提出μMatch框架,用于半监督学习与领域自适应,利用基础模型。通过实现先进的学生-教师方法,并在挑战性EM任务(包括线粒体、细胞核、神经突起分割)上评估多种基础模型(SAM、SAM2、μSAM、DINOv2/v3),结果表明该框架持续优于强基线,为显著降低EM标注工作量提供了可行路径。

原文摘要 · Abstract (English)

Vision foundation models have substantially advanced computer vision, enabling state-of-the-art performance in zero- and few-shot settings. They have been successfully applied to biomedical imaging tasks ranging from organ segmentation in computed tomography to cell segmentation in light microscopy. Electron microscopy (EM) is a central modality for analyzing cellular ultrastructure due to its nanometer-scale resolution. However, the application of foundation models in EM has so far been limited to specific organelles, such as mitochondria, largely due to the diversity of segmentation tasks and the scarcity of comprehensively annotated data. As a result, EM segmentation still predominantly relies on supervised learning, requiring extensive manual annotation and limiting ultrastructural analysis. To address this gap, we propose $μ$Match, a framework for semi-supervised learning and domain adaptation that leverages foundation models. We implement state-of-the-art student-teacher-based methods and evaluate multiple foundation models (SAM, SAM2, $μ$SAM, DINOv2/v3) on challenging EM tasks, including mitochondrion, nucleus, and neurite segmentation. Our results demonstrate consistent improvements over strong baselines and highlight a path toward substantially reducing the annotation effort in EM.

电子显微镜半监督学习基础模型图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。