arXiv:2502.20749eess.IVcs.CV2025-02

用基础模型提升医疗图像分割,少标注也能高效精准。

SemiSAM+: Rethinking Semi-Supervised Medical Image Segmentation in the Era of Foundation Models

  • 用可提示的基础模型+可训练的专用模型协作学习
  • 在极少量标注下实现显著性能提升,优于现有方法
  • 适配不同模型,即插即用,临床部署友好

基于深度学习的医学图像分割通常需要大量标注数据,而标注成本高限制了其在临床中的应用。半监督学习(SSL)因其对专家标注依赖较少而成为有吸引力的策略。随着可提示分割基础模型(如Segment Anything Model, SAM)的出现,我们提出SemiSAM+,一种面向医学图像分割的、由基础模型驱动的半监督学习框架。该框架包含一个或多个可提示的基础模型(通用模型)和一个可训练的任务专用模型(专用模型)。针对新任务,通过专用-通用模型协同学习:专用模型生成位置提示,与冻结的基础模型交互获取伪标签;基础模型输出为专用模型提供高效且信息丰富的监督信号,反向促进自动分割与提示生成。在两个公开数据集和一个院内临床数据集上的大量实验表明,SemiSAM+在极端标注稀缺场景下表现优异,且作为即插即用方案具备强适应性,可灵活适配不同模型组合。

原文摘要 · Abstract (English)

Deep learning-based medical image segmentation typically requires large amount of labeled data for training, making it less applicable in clinical settings due to high annotation cost. Semi-supervised learning (SSL) has emerged as an appealing strategy due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods. Beyond existing model-centric advancements of SSL by designing novel regularization strategies, we anticipate a paradigmatic shift due to the emergence of promptable segmentation foundation models with universal segmentation capabilities using positional prompts represented by Segment Anything Model (SAM). In this paper, we present SemiSAM+, a foundation model-driven SSL framework to efficiently learn from limited labeled data for medical image segmentation. SemiSAM+ consists of one or multiple promptable foundation models as generalist models, and a trainable task-specific segmentation model as specialist model. For a given new segmentation task, the training is based on the specialist-generalist collaborative learning procedure, where the trainable specialist model delivers positional prompts to interact with the frozen generalist models to acquire pseudo-labels, and then the generalist model output provides the specialist model with informative and efficient supervision which benefits the automatic segmentation and prompt generation in turn. Extensive experiments on two public datasets and one in-house clinical dataset demonstrate that SemiSAM+ achieves significant performance improvement, especially under extremely limited annotation scenarios, and shows strong efficiency as a plug-and-play strategy that can be easily adapted to different specialist and generalist models.

医学图像半监督基础模型分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。