arXiv:2508.15751cs.CV2025-08中稿 · Journal of Medical…被引 2

用分子信息增强的SAM模型,精准分割癌细胞亚型。

Fine-grained Multi-class Nuclei Segmentation with Molecular-empowered All-in-SAM Model

  • 结合分子信息引导标注,减少像素级标注负担。
  • 在自建与公开数据集上提升细胞分类准确率。
  • 适合资源有限的病理分析场景,推动自动化诊断。

目的:计算病理学的发展得益于视觉基础模型的进步,尤其是分割一切模型(SAM)。该模型通过提示驱动的零样本分割和细胞特异性SAM模型实现直接分割,有效覆盖多种核与细胞。然而,通用视觉基础模型在细粒度语义分割方面仍存在挑战,如识别特定核亚型或特定细胞。方法:本文提出分子赋能的All-in-SAM模型,通过全栈式设计推进计算病理学:(1) 通过分子赋能学习吸引非专业标注者参与,降低对精细像素级标注的需求;(2) 利用SAM适配器增强模型对特定语义的敏感性,发挥其强泛化能力;(3) 通过分子导向校正学习(MOCL)提升分割精度。结果:在自建及公开数据集上的实验表明,All-in-SAM模型即使在标注质量参差不齐的情况下,仍显著提升细胞分类性能。结论:该方法不仅减轻标注工作量,还使高精度生物医学图像分析可应用于资源受限环境,助力医疗诊断与病理图像自动化分析。

原文摘要 · Abstract (English)

Purpose: Recent developments in computational pathology have been driven by advances in Vision Foundation Models, particularly the Segment Anything Model (SAM). This model facilitates nuclei segmentation through two primary methods: prompt-based zero-shot segmentation and the use of cell-specific SAM models for direct segmentation. These approaches enable effective segmentation across a range of nuclei and cells. However, general vision foundation models often face challenges with fine-grained semantic segmentation, such as identifying specific nuclei subtypes or particular cells. Approach: In this paper, we propose the molecular-empowered All-in-SAM Model to advance computational pathology by leveraging the capabilities of vision foundation models. This model incorporates a full-stack approach, focusing on: (1) annotation-engaging lay annotators through molecular-empowered learning to reduce the need for detailed pixel-level annotations, (2) learning-adapting the SAM model to emphasize specific semantics, which utilizes its strong generalizability with SAM adapter, and (3) refinement-enhancing segmentation accuracy by integrating Molecular-Oriented Corrective Learning (MOCL). Results: Experimental results from both in-house and public datasets show that the All-in-SAM model significantly improves cell classification performance, even when faced with varying annotation quality. Conclusions: Our approach not only reduces the workload for annotators but also extends the accessibility of precise biomedical image analysis to resource-limited settings, thereby advancing medical diagnostics and automating pathology image analysis.

病理分割SAM模型分子信息细粒度识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。