无需训练和人工提示,实时优化骨骼分割模型精度
MedSAM2-Anatomy: Training-Free Inference-Time Optimization for Musculoskeletal Segmentation

- 利用冻结模型生成解剖先验,自动生成多个提示假设
- 融合候选掩码并剔除不合理先验,提升分割精度
- 适用于临床影像分析,尤其适合无标注数据场景
从CT和MRI中高分辨率分割髋关节和肩关节解剖结构对术前规划至关重要,但固定分割模型在域偏移下表现不佳。基于CNN的专家模型全自动但适应性差,可提示的基础模型泛化能力好但需人工提示。我们提出MedSAM2-Anatomy,一种无需训练、推理时优化的框架,可在不更新权重、无需人工干预的情况下提升冻结模型性能。一个冻结的专家模型生成解剖先验,自动转化为多个提示假设,输入到冻结的3D基础模型中。候选分割结果被融合,解剖上不合理的先验被剔除。使用TotalSegmentator作为专家模型,MedSAM2作为基础模型,可隔离推理策略贡献。在独立的Balgrist-V0 CT和MRI队列上评估显示:髋关节MRI的中位Dice从0.71提升至0.92,肩关节CT从0.89提升至0.92;髋关节MRI的中位HD95从22.0 mm降至5.0 mm。在公开的TotalSegmentator基准上,专家模型仍为最优,表明最佳融合策略取决于专家先验的可靠性。结果表明,无需训练的推理时优化是提升冻结分割模型的有效方法。
原文摘要 · Abstract (English)
High-resolution 3D segmentation of hip and shoulder anatomy from CT and MRI is essential for surgical planning, yet frozen segmentation models often fail under domain shift. CNN-based expert models are fully automatic but lack adaptability, whereas promptable foundation models generalize better but require manual prompting. We present MedSAM2-Anatomy, a training-free inference-time optimization framework that improves frozen segmentation models without retraining or human interaction. A frozen expert model generates anatomical priors that are automatically converted into multiple prompt hypotheses for a frozen 3D foundation model. Candidate masks are fused while anatomically implausible priors are rejected. No model weights are updated and no manual prompts are required. TotalSegmentator and MedSAM2 are used as representative expert and foundation models, allowing the contribution of the inference policy to be isolated. Evaluation on the independent Balgrist-V0 CT and MRI cohorts shows that inference-time optimization increases median Dice from 0.71 to 0.92 on hip MRI and from 0.89 to 0.92 on shoulder CT, while reducing median HD95 on hip MRI from 22.0 mm to 5.0 mm. On public TotalSegmentator benchmarks, the expert model remains strongest, indicating that the optimal fusion strategy depends on the reliability of the expert prior. These results demonstrate that training-free inference-time optimization provides a practical strategy for improving frozen segmentation models without manual prompting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。