arXiv:2506.08949cs.CV2025-06被引 5

用SAM-2和高效提示机制,让少量标注数据也能精准分割医学影像。

SSS: Semi-Supervised SAM-2 with Efficient Prompting for Medical Imaging Segmentation

  • 基于SAM-2的特征提取与多视角增强,挖掘未标注数据中的隐含信息。
  • 在BHSD数据集上达到53.15平均Dice,比之前最佳方法高3.65。
  • 适合需要低标注成本的医学图像分割任务,尤其适用于多标签场景。

在信息爆炸时代,如何高效利用大规模未标注数据并减少对高质量像素级标注的依赖,是医学图像分析的关键挑战。半监督学习通过知识迁移提升未标注数据利用率,显著改善全监督模型性能,成为该领域重要研究方向。受视觉基础模型(如SAM-2)提供丰富先验知识能力的启发,本文提出SSS(Semi-Supervised SAM-2),利用SAM-2强大的特征提取能力挖掘未标注医学图像中的潜在知识,从而有效增强全监督分割的特征支持。具体地,在单流“弱到强”一致性正则框架基础上,引入判别性特征增强(DFE)机制,进一步探索不同数据增强策略在多视角下引入的特征差异。通过融合多尺度增强下的特征相似性与差异性,重构并建模特征,有效优化显著区域。此外,设计了一个结合物理约束与滑动窗口(PCSW)机制的提示生成器,为未标注数据生成符合SAM-2要求的输入提示。大量实验表明,该方法在两个多标签数据集ACDC和BHSD上均表现优异。值得注意的是,SSS在BHSD上取得53.15的平均Dice分数,超越此前最先进方法3.65个点。代码将发布于https://github.com/AIGeeksGroup/SSS。

原文摘要 · Abstract (English)

In the era of information explosion, efficiently leveraging large-scale unlabeled data while minimizing the reliance on high-quality pixel-level annotations remains a critical challenge in the field of medical imaging. Semi-supervised learning (SSL) enhances the utilization of unlabeled data by facilitating knowledge transfer, significantly improving the performance of fully supervised models and emerging as a highly promising research direction in medical image analysis. Inspired by the ability of Vision Foundation Models (e.g., SAM-2) to provide rich prior knowledge, we propose SSS (Semi-Supervised SAM-2), a novel approach that leverages SAM-2's robust feature extraction capabilities to uncover latent knowledge in unlabeled medical images, thus effectively enhancing feature support for fully supervised medical image segmentation. Specifically, building upon the single-stream "weak-to-strong" consistency regularization framework, this paper introduces a Discriminative Feature Enhancement (DFE) mechanism to further explore the feature discrepancies introduced by various data augmentation strategies across multiple views. By leveraging feature similarity and dissimilarity across multi-scale augmentation techniques, the method reconstructs and models the features, thereby effectively optimizing the salient regions. Furthermore, a prompt generator is developed that integrates Physical Constraints with a Sliding Window (PCSW) mechanism to generate input prompts for unlabeled data, fulfilling SAM-2's requirement for additional prompts. Extensive experiments demonstrate the superiority of the proposed method for semi-supervised medical image segmentation on two multi-label datasets, i.e., ACDC and BHSD. Notably, SSS achieves an average Dice score of 53.15 on BHSD, surpassing the previous state-of-the-art method by +3.65 Dice. Code will be available at https://github.com/AIGeeksGroup/SSS.

医学图像半监督分割SAM-2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。