arXiv:2506.02854cs.CV2025-06被引 5

无需人工提示,自动生成抽象提示实现医学图像精准分割

Hierarchical Self-Prompting SAM: A Prompt-Free Medical Image Segmentation Framework

  • 通过学习抽象提示替代位置提示,实现完全无提示的医学图像分割
  • 在息肉和皮肤病变分割任务上超越现有方法,最高提升14.04%
  • 适用于多种医学影像模态,对未见数据集也有强泛化能力

尽管分割一切模型(SAM)在自然图像分割中表现优异,但其依赖人工提示的特性限制了在医学影像中的应用,因医学图像常缺乏可手动标注的提示。现有微调SAM的方法仍难以摆脱该依赖。本文提出分层自提示SAM(HSP-SAM),一种新颖的无提示分割框架,使SAM可在无提示条件下实现强大性能。与以往仅生成位置提示的方法不同,我们首次在自提示过程中学习抽象提示。这一简洁直观的框架在经典分割任务如息肉与皮肤病变分割中表现卓越,且在多种医学影像模态下保持鲁棒性。此外,其在未见数据集上展现出强泛化能力,在部分挑战性基准上相较先前最优方法提升高达14.04%。结果表明,抽象提示比位置提示蕴含更丰富、更高维的语义信息,从而显著提升模型鲁棒性与泛化性能。所有模型与代码将在论文接受后公开。

原文摘要 · Abstract (English)

Although the Segment Anything Model (SAM) is highly effective in natural image segmentation, it requires dependencies on prompts, which limits its applicability to medical imaging where manual prompts are often unavailable. Existing efforts to fine-tune SAM for medical segmentation typically struggle to remove this dependency. We propose Hierarchical Self-Prompting SAM (HSP-SAM), a novel self-prompting framework that enables SAM to achieve strong performance in prompt-free medical image segmentation. Unlike previous self-prompting methods that remain limited to positional prompts similar to vanilla SAM, we are the first to introduce learning abstract prompts during the self-prompting process. This simple and intuitive self-prompting framework achieves superior performance on classic segmentation tasks such as polyp and skin lesion segmentation, while maintaining robustness across diverse medical imaging modalities. Furthermore, it exhibits strong generalization to unseen datasets, achieving improvements of up to 14.04% over previous state-of-the-art methods on some challenging benchmarks. These results suggest that abstract prompts encapsulate richer and higher-dimensional semantic information compared to positional prompts, thereby enhancing the model's robustness and generalization performance. All models and codes will be released upon acceptance.

医学图像分割自提示无监督SAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。