arXiv:2410.06825eess.IVcs.LG2024-10被引 1

用预训练U-Net自动选提示,提升SAM在胸片肺部分割的零样本性能

K-SAM: A Prompting Method Using Pretrained U-Net to Improve Zero Shot Performance of SAM on Lung Segmentation in CXR Images

  • 通过两个U-Net预测肺和心脏区域,生成正负提示点输入SAM
  • 在两个数据集上达到95.5%和94.9%的平均Dice分数
  • 无需人工干预,全自动提示选择,适合临床快速部署

在临床诊断中,精确定位目标区域是关键步骤。对于许多诊断任务,胸片(CXR)中的肺部分割是首要步骤,可显著缩小图像尺寸以加速后续分析。该任务的主要挑战在于遮挡密集异常(如肺炎、结核)时的肺部分割。SAM具备出色的类别无关分割泛化能力。本研究提出一种方法,通过自动提示选择来提升SAM在肺部分割任务上的零样本性能。训练了两个独立的U-Net模型,分别用于预测肺部和心脏区域。尽管这些预测在边缘细节上不够精细,但可作为正负提示输入SAM。使用所提方法,在两个基准数据集上评估了SAM的零样本性能。其中,ViT-l版本表现最佳,相较于ViTh和ViTb,分别在两个数据集上取得95.5%和94.9%的平均Dice分数。尽管大多数图像分割效果优异,但在部分极端异常或形状扭曲的图像上,分割结果偏差较大。与以往基于SAM的肺部分割研究不同,本研究实现了仅从输入图像出发的全自动提示选择。研究结果表明,利用预训练模型进行提示选择,可充分释放SAM的强大泛化能力。

原文摘要 · Abstract (English)

In clinical procedures, precise localization of the target area is an essential step for clinical diagnosis and screening. For many diagnostic applications, lung segmentation of chest X-ray images is an essential first step that significantly reduces the image size to speed up the subsequent analysis. One of the primary difficulties with this task is segmenting the lung regions covered by dense abnormalities also known as opacities due to diseases like pneumonia and tuberculosis. SAM has astonishing generalization capabilities for category agnostic segmentation. In this study we propose an algorithm to improve zero shot performance of SAM on lung region segmentation task by automatic prompt selection. Two separate UNet models were trained, one for predicting lung segments and another for heart segment. Though these predictions lack fine details around the edges, they provide positive and negative points as prompt for SAM. Using proposed prompting method zero shot performance of SAM is evaluated on two benchmark datasets. ViT-l version of the model achieved slightly better performance compared to other two versions, ViTh and ViTb. It yields an average Dice score of 95.5 percent and 94.9 percent on hold out data for two datasets respectively. Though, for most of the images, SAM did outstanding segmentation, its prediction was way off for some of the images. After careful inspection it is found that all of these images either had extreme abnormality or distorted shape. Unlike most of the research performed so far on lung segmentation from CXR images using SAM, this study proposes a fully automated prompt selection process only from the input image. Our finding indicates that using pretrained models for prompt selection can utilize SAM impressive generalization capability to its full extent.

肺部分割SAMU-Net零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。