让医学影像分割能输出多种合理结果,反映专家间分歧。
A Probabilistic Segment Anything Model for Ambiguity-Aware Medical Image Segmentation
- 用潜在变量建模分割结果分布,实现不确定性感知
- 在LIDC-IDRI数据集上生成多样且符合专家意见的分割图
- 仅需轻微计算开销,适合临床辅助诊断场景
近期可提示分割模型(如SAM)在多种视觉任务中实现了高质量、灵活的掩码生成。然而,这类模型本质为确定性,每张图每个提示仅输出单一分割结果,无法捕捉真实任务中的固有模糊性。这一缺陷在医学影像中尤为突出,因标注不确定或专家间差异可能导致多个合理分割。本文提出概率化SAM,通过在输入图像和提示条件下建模分割分布,学习生成多样且合理的分割掩码。该模型在SAM框架中引入先验与后验网络,利用潜在变量空间调节提示嵌入,在推理时高效采样,实现低开销的不确定性输出。在公开LIDC-IDRI肺结节数据集上的实验表明,模型能生成符合专家分歧的多样化结果,优于现有概率基线,在不确定性度量指标上表现更优。代码已开源。
原文摘要 · Abstract (English)
Recent advances in promptable segmentation, such as the Segment Anything Model (SAM), have enabled flexible, high-quality mask generation across a wide range of visual domains. However, SAM and similar models remain fundamentally deterministic, producing a single segmentation per object per prompt, and fail to capture the inherent ambiguity present in many real-world tasks. This limitation is particularly troublesome in medical imaging, where multiple plausible segmentations may exist due to annotation uncertainty or inter-expert variability. In this paper, we introduce Probabilistic SAM, a probabilistic extension of SAM that models a distribution over segmentations conditioned on both the input image and prompt. By incorporating a latent variable space and training with a variational objective, our model learns to generate diverse and plausible segmentation masks reflecting the variability in human annotations. The architecture integrates a prior and posterior network into the SAM framework, allowing latent codes to modulate the prompt embeddings during inference. The latent space allows for efficient sampling during inference, enabling uncertainty-aware outputs with minimal overhead. We evaluate Probabilistic SAM on the public LIDC-IDRI lung nodule dataset and demonstrate its ability to produce diverse outputs that align with expert disagreement, outperforming existing probabilistic baselines on uncertainty-aware metrics. Our code is available at: https://github.com/tbwa233/Probabilistic-SAM/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。