用轻量框预测器提升医学图像分割精度,仅增160万参数
Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation

- 通过单点击生成候选框,缓解点提示信息不足问题
- 在四个数据集上最高达0.98的Dice分数,显著提升鲁棒性
- 适合需要快速交互式分割的临床医生和研究者
医学图像语义分割因数据稀缺和模态差异大而极具挑战。尽管基础模型如通用图像分割模型(SAM)前景广阔,但在未针对性适配的情况下对医学图像表现不佳。点提示虽自然,但缺乏足够空间上下文,尤其在结构不规则或对比度低时易导致分割不准。本文提出一种增强型分割框架,在MedSAM架构中集成轻量级框预测模块。该模块基于局部图像嵌入特征,从单次用户点击估计近似边界框,提供空间引导以降低点提示的歧义性,额外参数仅160万,推理开销可忽略。采用两阶段训练流程,先独立训练框预测器再整合进MedSAM。在涵盖CT、MRI和超声的四个不同数据集(FLARE22、BRISC、BUSI、LungSegDB)上进行广泛评估,结果表明方法在多种解剖结构和成像域下均显著提升分割准确率与鲁棒性,取得0.89(BUSI)、0.93(FLARE22)、0.88(BRISC)和0.98(LungSegDB)的Dice分数。代码已开源。
原文摘要 · Abstract (English)
Semantic segmentation in medical imaging is a critical yet challenging task due to data scarcity and high variability across modalities. While foundation models like the Segment Anything Model (SAM) show promise, they often struggle with medical images without specific adaptation. Moreover, point prompts, despite being the most natural form of user interaction, provide insufficient spatial context for reliable segmentation, particularly when target structures are irregular or poorly contrasted. In this paper, we propose an enhanced segmentation framework that integrates a lightweight Box Predictor module into the MedSAM architecture. The Box Predictor estimates an approximate bounding box from a single user click using localized image embedding features, providing spatial guidance that reduces the ambiguity of point prompts, while introducing only 1.6M additional parameters and negligible inference overhead. We introduce a two-stage training pipeline where the Box Predictor is trained independently before being integrated into MedSAM. To validate the generalization capability of our method, we conduct extensive evaluations on four diverse datasets (FLARE22, BRISC, BUSI, LungSegDB) spanning distinct imaging modalities, including CT, MRI, and Ultrasound. Our method improves segmentation accuracy and robustness across varied anatomical structures and imaging domains, achieving Dice scores of 0.89 (BUSI), 0.93 (FLARE22), 0.88 (BRISC), and 0.98 (LungSegDB). Code is available at https://github.com/Amirhosseinmovahedi/MedSAM-BoxPredictor
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。