无需提示词,用分层概率表示提升医学图像分割精度
HPR-SAM: Hierarchical Probabilistic Representation Learning for Prompt-free SAM-based Medical Image Segmentation

- 构建分层概率表示框架,融合全局先验与局部可靠性
- 在Synapse上达顶尖性能,在少样本下LA和PROMISE12最优
- 适合追求高精度、少标注的医学图像分割研究者
免提示词的Segment Anything Model(SAM)适配已成为自动医学图像分割的有前景方向。现有方法多聚焦于提示生成,却忽视提示质量受限于解剖表示的表达能力。确定性原型或语义令牌难以同时捕捉全局解剖先验、结构内差异性及局部结构可靠性。为此,我们提出分层概率表示(HPR)框架,通过分布解剖表示(DAR)、多组件解剖表示(MAR)和局部可靠性表示(LRR)学习互补解剖表征,并利用分层预测融合(HPF)整合其输出,保持与原SAM解码器兼容。在Synapse、LA和PROMISE12数据集上的实验表明,HPR-SAM在Synapse上达到顶尖性能,在少数样本设置下于LA和PROMISE12表现最佳,验证了该分层概率表示学习框架在免提示词医学图像分割中的有效性。代码已公开于https://anonymous.4open.science/r/HPR-SAM-E4AF。
原文摘要 · Abstract (English)
Prompt-free adaptation of the Segment Anything Model (SAM) has emerged as a promising paradigm for automatic medical image segmentation. Existing methods mainly focus on prompt generation, while overlooking that prompt quality is fundamentally constrained by the expressiveness of anatomical representations. However, deterministic prototypes or semantic tokens are insufficient to jointly capture global anatomical priors, intra-structure diversity, and local structural reliability. To address this limitation, we propose the Hierarchical Probabilistic Representation (HPR) framework, which learns complementary anatomical representations through Distributional Anatomical Representation (DAR), Multi-component Anatomical Representation (MAR), and Local Reliability Representation (LRR), and integrates their predictions via Hierarchical Prediction Fusion (HPF) while remaining compatible with the original SAM decoder. Experiments on the Synapse, LA, and PROMISE12 datasets demonstrate that HPR-SAM achieves state-of-the-art performance on Synapse and the best performance under few-shot settings on LA and PROMISE12, validating the effectiveness of the proposed hierarchical probabilistic representation learning framework for prompt-free medical image segmentation. Code is available at https://anonymous.4open.science/r/HPR-SAM-E4AF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。