arXiv:2506.20786cs.CV2025-06

对比多种AI模型在脑瘤分割中的表现,发现精准提示下新模型可超传统方法。

AI-Driven MRI-based Brain Tumour Segmentation Benchmarking

  • 用点和框提示测试SAM系列与nnU-Net在BraTS数据集上的零样本分割能力。
  • 精准框提示下SAM与SAM 2 Dice分数达0.894和0.893,超过nnU-Net。
  • 微调后点提示性能提升明显,但仍不及框提示或nnU-Net

医学图像分割极大助力诊断,基于U-Net的架构与nnU-Net表现领先。近年来涌现众多通用及医疗变体模型,但缺乏在统一医疗数据集上对不同提示质量的系统评估。本研究使用SAM、SAM 2、MedSAM、SAM-Med-3D与nnU-Net,在BraTS 2023成人与儿科胶质瘤数据集上进行零样本推理,测试点提示与框提示。部分模型表现优异,尤其在高精度框提示下,SAM与SAM 2 Dice分数分别达0.894与0.893,超越nnU-Net。然而,因难以获取高精度提示,nnU-Net仍是主流。研究进一步在儿科数据集上微调SAM、SAM 2、MedSAM与SAM-Med-3D,微调后点提示性能显著提升,但仍未优于框提示或nnU-Net。

原文摘要 · Abstract (English)

Medical image segmentation has greatly aided medical diagnosis, with U-Net based architectures and nnU-Net providing state-of-the-art performance. There have been numerous general promptable models and medical variations introduced in recent years, but there is currently a lack of evaluation and comparison of these models across a variety of prompt qualities on a common medical dataset. This research uses Segment Anything Model (SAM), Segment Anything Model 2 (SAM 2), MedSAM, SAM-Med-3D, and nnU-Net to obtain zero-shot inference on the BraTS 2023 adult glioma and pediatrics dataset across multiple prompt qualities for both points and bounding boxes. Several of these models exhibit promising Dice scores, particularly SAM and SAM 2 achieving scores of up to 0.894 and 0.893, respectively when given extremely accurate bounding box prompts which exceeds nnU-Net's segmentation performance. However, nnU-Net remains the dominant medical image segmentation network due to the impracticality of providing highly accurate prompts to the models. The model and prompt evaluation, as well as the comparison, are extended through fine-tuning SAM, SAM 2, MedSAM, and SAM-Med-3D on the pediatrics dataset. The improvements in point prompt performance after fine-tuning are substantial and show promise for future investigation, but are unable to achieve better segmentation than bounding boxes or nnU-Net.

脑瘤分割SAM模型医学影像零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。