arXiv:2510.16450cs.CV2025-10中稿 · Neuroinformatics

用稀疏标注点提升电子显微图像线粒体分割,效果接近有监督方法。

Instance-Aware Pseudo-Labeling and Class-Focused Contrastive Learning for Weakly Supervised Domain Adaptive Segmentation of Electron Microscopy

  • 结合分割与中心检测,用跨教学机制增强伪标签可靠性。
  • 在多个数据集上显著超越现有无监督与弱监督方法,接近有监督性能。
  • 适合生物医学图像分割,尤其适用于标注成本高的场景。

从多种电子显微镜(EM)图像中高效标注大量线粒体实例对生物和神经科学研究具有重要意义。尽管无监督域适应(UDA)方法可缓解域偏移并降低标注成本,但实际应用中性能仍较低。为此,我们研究弱监督域适应(WDA),利用目标域中少量稀疏点标注,仅需极少标注工作量与专家知识。为充分利用不完整且不精确的点标注,提出一种多任务学习框架,联合进行分割与中心检测,并引入新颖的跨教学机制和面向类别的跨域对比学习。在利用无标签图像区域时,提出基于实例感知伪标签(IPL)选择策略的自训练方法。不同于依赖像素级伪标签过滤的现有方法,该策略借助检测任务语义选择可靠且多样化的伪标签。在挑战性数据集上的全面验证表明,本方法显著优于现有UDA与WDA方法,大幅缩小与有监督上界之间的差距。此外,在UDA设置下也明显优于其他UDA技术。

原文摘要 · Abstract (English)

Annotation-efficient segmentation of the numerous mitochondria instances from various electron microscopy (EM) images is highly valuable for biological and neuroscience research. Although unsupervised domain adaptation (UDA) methods can help mitigate domain shifts and reduce the high costs of annotating each domain, they typically have relatively low performance in practical applications. Thus, we investigate weakly supervised domain adaptation (WDA) that utilizes additional sparse point labels on the target domain, which require minimal annotation effort and minimal expert knowledge. To take full use of the incomplete and imprecise point annotations, we introduce a multitask learning framework that jointly conducts segmentation and center detection with a novel cross-teaching mechanism and class-focused cross-domain contrastive learning. While leveraging unlabeled image regions is essential, we introduce segmentation self-training with a novel instance-aware pseudo-label (IPL) selection strategy. Unlike existing methods that typically rely on pixel-wise pseudo-label filtering, the IPL semantically selects reliable and diverse pseudo-labels with the help of the detection task. Comprehensive validations and comparisons on challenging datasets demonstrate that our method outperforms existing UDA and WDA methods, significantly narrowing the performance gap with the supervised upper bound. Furthermore, under the UDA setting, our method also achieves substantial improvements over other UDA techniques.

图像分割弱监督域适应电子显微镜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。