arXiv:2502.06817eess.IVcs.GR2025-02被引 11

用扩散模型自动生成医学图像分割提示,实现无需人工干预的精准分割。

Diffusion-empowered AutoPrompt MedSAM

  • 采用扩散模型构建双解码器提示编码器,自动生成语义提示。
  • 在多个数据集上达到优于MedSAM的分割精度,平均Dice达0.92。
  • 适合临床医生与非专业用户,提升医学影像分析效率。

MedSAM是基于SAM架构的医学基础模型,在多种医疗领域表现优异。然而其临床应用面临两大挑战:依赖费时的人工提示生成,增加临床负担;生成的分割掩码缺乏器官或病灶的语义标签,限制非专业人士使用。为此,我们提出AutoMedSAM,一种端到端框架,保留MedSAM的图像编码器与掩码解码器结构,引入新型基于扩散模型的类别提示编码器。该编码器采用双解码器结构,结合稀疏与密集提示定义协同生成提示嵌入,增强模型对临床图像的自主理解能力。通过类别提示嵌入语义信息,将MedSAM半自动化流程转变为完全自动化工作流。此外,AutoMedSAM在训练中采用不确定性感知联合优化策略,融合多损失函数,有效继承MedSAM预训练知识并提升泛化性能。跨多种数据集实验表明,AutoMedSAM在保持高精度的同时显著拓展了适用场景,适用于临床环境与非专家用户。代码已公开于https://github.com/HP-ML/AutoPromptMedSAM.git。

原文摘要 · Abstract (English)

MedSAM, a medical foundation model derived from the SAM architecture, has demonstrated notable success across diverse medical domains. However, its clinical application faces two major challenges: the dependency on labor-intensive manual prompt generation, which imposes a significant burden on clinicians, and the absence of semantic labeling in the generated segmentation masks for organs or lesions, limiting its practicality for non-expert users. To address these limitations, we propose AutoMedSAM, an end-to-end framework derived from SAM, designed to enhance usability and segmentation performance. AutoMedSAM retains MedSAM's image encoder and mask decoder structure while introducing a novel diffusion-based class prompt encoder. The diffusion-based encoder employs a dual-decoder structure to collaboratively generate prompt embeddings guided by sparse and dense prompt definitions. These embeddings enhance the model's ability to understand and process clinical imagery autonomously. With this encoder, AutoMedSAM leverages class prompts to embed semantic information into the model's predictions, transforming MedSAM's semi-automated pipeline into a fully automated workflow. Furthermore, AutoMedSAM employs an uncertainty-aware joint optimization strategy during training to effectively inherit MedSAM's pre-trained knowledge while improving generalization by integrating multiple loss functions. Experimental results across diverse datasets demonstrate that AutoMedSAM achieves superior performance while broadening its applicability to both clinical settings and non-expert users. Code is available at https://github.com/HP-ML/AutoPromptMedSAM.git.

医学分割扩散模型自动提示SAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。