arXiv:2507.17281cs.CV2025-07中稿 · presentation at th…被引 1

让医学图像分割自动用SAM,无需人工标注提示

Fully Automated SAM for Single-source Domain Generalization in Medical Image Segmentation

  • 用浅层特征不确定性生成自动提示框,实现全流程自动化
  • 融合图像与提示嵌入信息,提升对错误提示的鲁棒性
  • 适合临床部署,尤其在缺乏专家标注的场景

基于SAM的单源领域泛化医学图像分割模型虽能缓解跨域场景中的域偏移影响,但仍面临两大挑战:一是分割依赖领域特定专家标注提示,难以实现全自动;二是不良提示(如过大或过小边界框)会误导SAM生成错误掩码。为此,提出FA-SAM框架,引入两个关键创新:具备浅层特征不确定性建模(SUFM)的自动提示生成模块(AGM),以及集成于SAM掩码解码器的图像-提示嵌入融合(IPEF)模块。AGM通过建模浅层特征不确定性,为目标域生成边界框提示,实现完全自动化分割;IPEF融合多尺度图像嵌入与提示嵌入,捕捉目标物体的全局与局部细节,增强对劣质提示的鲁棒性。在公开前列腺和视网膜血管数据集上的大量实验验证了FA-SAM的有效性,凸显其解决上述挑战的潜力。

原文摘要 · Abstract (English)

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the segmentation of SAM is highly dependent on domain-specific expert-annotated prompts, which prevents SAM from achieving fully automated medical image segmentation and therefore limits its application in clinical settings. Second, providing poor prompts (such as bounding boxes that are too small or too large) to the SAM prompt encoder can mislead SAM into generating incorrect mask results. Therefore, we propose the FA-SAM, a single-source domain generalization framework for medical image segmentation that achieves fully automated SAM. FA-SAM introduces two key innovations: an Auto-prompted Generation Model (AGM) branch equipped with a Shallow Feature Uncertainty Modeling (SUFM) module, and an Image-Prompt Embedding Fusion (IPEF) module integrated into the SAM mask decoder. Specifically, AGM models the uncertainty distribution of shallow features through the SUFM module to generate bounding box prompts for the target domain, enabling fully automated segmentation with SAM. The IPEF module integrates multiscale information from SAM image embeddings and prompt embeddings to capture global and local details of the target object, enabling SAM to mitigate the impact of poor prompts. Extensive experiments on publicly available prostate and fundus vessel datasets validate the effectiveness of FA-SAM and highlight its potential to address the above challenges.

医学图像自动分割SAM领域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。