用注意力机制从模糊标注中提炼可靠分割提示,提升医学影像模型鲁棒性。
Learning from Noisy Prompts: Saliency-Guided Prompt Distillation for Robust Segmentation with SAM

- 通过轻量级注意力头学习解剖先验,生成可信定位图。
- 利用相邻切片信息验证并丰富噪声提示,提升分割一致性。
- 适合临床中仅有粗糙标注的场景,显著改善分割精度。
分割在临床诊断与监测中至关重要,但现代基础模型的可靠性仍依赖精确提示。尽管分割一切模型(SAM)具备强大的零样本能力,但在真实临床流程中普遍存在的弱、通用且含噪提示下表现崩溃。实际标注如中心线点常粗糙且模糊,易偏离邻近解剖结构,误导SAM生成不一致或不完整的掩码。本文提出SPD框架——一种基于显著性的提示蒸馏方法,将不可靠提示转化为稳健引导。SPD首先通过轻量级显著性头学习数据驱动的解剖先验,获得置信的定位图;随后利用解剖邻近切片的上下文信息,进行提示验证与增强,生成符合专家推理行为的一致提示集;再通过成对切片一致性目标强化局部解剖一致性。在四个挑战性的MRI和CT基准上实验表明,SPD持续优于现有SAM改进方案及监督基线,在区域与边界指标上均取得显著提升。SPD为仅能获取不完美提示的临床环境中的基础模型部署提供了实用且原理清晰的路径。
原文摘要 · Abstract (English)
Segmentation is central to clinical diagnosis and monitoring, yet the reliability of modern foundation models in medical imaging still depends on the availability of precise prompts. The Segment Anything Model (SAM) offers powerful zero-shot capabilities, although it collapses under the weak, generic, and noisy prompts that dominate real clinical workflows. In practice, annotations such as centerline points are coarse and ambiguous, often drifting across neighboring anatomy and misguiding SAM toward inconsistent or incomplete masks. We introduce SPD, a Saliency-Guided Prompt Distillation framework that converts these unreliable cues into robust guidance. SPD first learns data-driven anatomical priors through a lightweight saliency head to obtain confident localization maps. These priors then drive Contextual Prompt Distillation, which validates and enriches noisy prompts using cues from anatomically adjacent slices, producing a consensus prompt set that matches the behavior of expert reasoning. A Pairwise Slice Consistency objective further enforces local anatomical coherence during segmentation. Experiments on four challenging MRI and CT benchmarks demonstrate that SPD consistently outperforms existing SAM adaptations and supervised baselines, delivering large gains in both region-based and boundary-based metrics. SPD provides a practical and principled path toward reliable foundation model deployment in clinical environments where only imperfect prompts are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。