arXiv:2504.20837cs.CVcs.AI2025-04被引 8

用单个2D提示实现3D医学图像精准分割,提升临床效率。

RadSAM: Segmenting 3D radiological images with a 2D promptable model

  • 基于2D模型,仅需一个提示即可完成3D医学图像分割。
  • 在AMOS数据集上达到当前最佳性能,3D分割精度显著提升。
  • 支持交互编辑,适合需要快速精准分割的临床医生使用。

医学图像分割是临床诊疗中的关键且耗时的任务,掩码精度至关重要。虽然通用分割模型SAM具备良好的泛化能力,无需预定义类别,可适应多样目标,但其基于自然图像训练,难以有效处理医学数据;且仅支持2D图像,而医学影像(如CT、MRI)本质为3D。现有医疗领域适配方案多依赖2D模型,需逐切片输入提示,过程繁琐,且缺乏编辑功能。为此,我们提出RadSAM,一种基于2D模型、仅需单个提示即可完成3D物体分割的新方法。通过在噪声掩码基础上训练2D模型,并引入迭代推理流程,逐切片重建3D掩码。我们构建了基准测试评估模型在单提示下的3D分割能力、域外迁移性及编辑性能。在AMOS腹部器官分割数据集上的实验表明,该方法优于现有先进模型。

原文摘要 · Abstract (English)

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on visual prompting and edition to refine an initial segmentation. This model has strong generalization capabilities, does not rely on predefined classes, and adapts to diverse objects; however, it is pre-trained on natural images and lacks the ability to process medical data effectively. In addition, this model is built for 2D images, whereas a whole medical domain is based on 3D images, such as CT and MRI. Recent adaptations of SAM for medical imaging are based on 2D models, thus requiring one prompt per slice to segment 3D objects, making the segmentation process tedious. They also lack important features such as editing. To bridge this gap, we propose RadSAM, a novel method for segmenting 3D objects with a 2D model from a single prompt. In practice, we train a 2D model using noisy masks as initial prompts, in addition to bounding boxes and points. We then use this novel prompt type with an iterative inference pipeline to reconstruct the 3D mask slice-by-slice. We introduce a benchmark to evaluate the model's ability to segment 3D objects in CT images from a single prompt and evaluate the models' out-of-domain transfer and edition capabilities. We demonstrate the effectiveness of our approach against state-of-the-art models on this benchmark using the AMOS abdominal organ segmentation dataset.

医学图像3D分割提示学习交互分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。