用合成提示提升肺结节分割效果,降低对人工标注的依赖。
What Matters is the Prompt: Prompt Sensitivity and Prompt Generation in Foundation Models for Lung Nodule Segmentation

- 设计合成提示生成模型,自动替代人工标注的点/框提示
- 合成提示使Dice系数达0.85,优于手动提示
- 适合需要减少人工标注的医疗影像分割场景
肺部结节分割在计算机断层扫描中对肺癌评估和治疗规划至关重要。基础模型虽展现出显著分割能力,但当前先进方法多依赖输入提示(如点或框),其性能易受提示质量与位置影响。本文研究提示质量对基础模型分割性能的影响,并提出一种合成提示生成模型,探索是否可通过自动生成提示来缓解对人工提示的依赖并提升分割效果。扰动实验表明,边界框提示通常优于点提示,且专用医学图像模型表现优于通用模型。所提方法获得0.85的Dice系数,表明合成提示生成是基于基础模型进行肺结节分割的有前景策略。
原文摘要 · Abstract (English)
Lung nodule segmentation in computed tomography is essential for extracting clinically relevant information for lung cancer assessment and treatment planning. Foundation models have shown notable segmentation capabilities, but state-of-the-art approaches often depend on input prompts, such as points or boxes, making their performance sensitive to prompt quality and placement. Understanding the limitations and constraints of prompt-based foundation models is therefore essential for designing reliable medical image segmentation solutions. In this work, we investigate how prompt quality affects foundation models performance for lung nodule segmentation. We further propose a synthetic prompt-generation model to test if the dependence on manually provided prompts can be mitigated by generating synthetic prompts that can also improve segmentation performance. Perturbation experiments show that bounding box prompts generally outperform point prompts, while latest specialized medical imaging models achieve better performance than general purpose ones. The proposed approach obtains a Dice coefficient of 0.85, suggesting that synthetic prompt generation as a promising strategy for lung nodule segmentation with foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。