用背景提示抑制SAM过分割,提升医学图像少样本分割精度
Focus on Background: Exploring SAM's Potential in Few-shot Medical Image Segmentation with Background-centric Prompting
- 设计背景中心提示生成器,将分割转为提示定位任务
- 在三个数据集上显著超越基线,跨域泛化能力强
- 适合需要高精度少样本医学分割的临床研究者
传统少样本医学图像分割方法受限于性能瓶颈,难以广泛应用于临床。尽管通用分割模型SAM具备强大的类别无关分割能力,但直接用于医学图像常因解剖边界模糊导致过分割。本文将基于SAM的少样本医学分割重构为提示定位任务,提出背景中心提示生成器FoB,通过精准生成背景提示来约束SAM的过分割问题。FoB采用类别无关的方式生成支持集背景提示,并直接在查询图像中定位这些提示;为应对新类别提示定位挑战,其建模丰富的上下文信息以捕捉前景-背景空间依赖关系。此外,借鉴医学图像中背景提示的内在结构模式,将该结构作为约束逐步优化背景提示预测。在三个多样化的医学图像数据集上的实验表明,FoB显著优于其他基线方法,达到当前最优性能,并展现出强跨域泛化能力。代码已开源:https://github.com/primebo1/FoB_SAM。
原文摘要 · Abstract (English)
Conventional few-shot medical image segmentation (FSMIS) approaches face performance bottlenecks that hinder broader clinical applicability. Although the Segment Anything Model (SAM) exhibits strong category-agnostic segmentation capabilities, its direct application to medical images often leads to over-segmentation due to ambiguous anatomical boundaries. In this paper, we reformulate SAM-based FSMIS as a prompt localization task and propose FoB (Focus on Background), a background-centric prompt generator that provides accurate background prompts to constrain SAM's over-segmentation. Specifically, FoB bridges the gap between segmentation and prompt localization by category-agnostic generation of support background prompts and localizing them directly in the query image. To address the challenge of prompt localization for novel categories, FoB models rich contextual information to capture foreground-background spatial dependencies. Moreover, inspired by the inherent structural patterns of background prompts in medical images, FoB models this structure as a constraint to progressively refine background prompt predictions. Experiments on three diverse medical image datasets demonstrate that FoB outperforms other baselines by large margins, achieving state-of-the-art performance on FSMIS, and exhibiting strong cross-domain generalization. Our code is available at https://github.com/primebo1/FoB_SAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。