仅用一个标注样本实现高效医学图像分割,突破标注瓶颈。
SemiSAM-O1: Pushing the Boundary of Annotation-Efficient Medical Image Segmentation with Generalist Knowledge Fusion
- 利用大模型特征提取能力,从单个标注样例生成初始伪标签。
- 通过迭代优化与不确定度引导,使分割精度接近全监督水平。
- 适合标注稀缺的医学影像任务,尤其适用于多模态复杂数据。
半监督学习(SSL)已成为缓解基于深度学习的医学图像分割模型标注负担的有前景方案。尽管基于基础模型的SSL进展已将标注需求降至极低水平,但在复杂成像模态下仍难以保持鲁棒的竞争力。本文提出SemiSAM-O1,一种仅需一个标注模板案例即可完成分割的高效框架。该方法通过充分挖掘基础模型在提示接口之外的特征表示能力,将专家-通用协同学习框架拓展至极致的一标签场景。SemiSAM-O1分两阶段运行:第一阶段,基础模型编码器提取所有体积的密集特征,基于单个标注样本生成类别原型,并通过特征相似性传播至未标注集,生成粗略初始伪标签;第二阶段,通过迭代训练与精炼循环,逐步提升分割模型与伪标签质量,每轮均从头训练模型并生成带体素级不确定性估计的新预测。不确定性引导的精炼步骤进一步利用基础模型的全局特征空间,通过聚合最相似且高置信邻居的标签来修正高不确定性区域,形成模型与伪标签相互提升的良性循环。在多种模态和解剖目标上的广泛实验表明,SemiSAM-O1显著缩小了一标签半监督学习与全监督之间的性能差距,同时大幅降低在线基础模型推理的计算开销。
原文摘要 · Abstract (English)
Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to extremely limited annotation scenarios, they fail to maintain robust competitive performance in complex imaging modalities. In this paper, we propose SemiSAM-O1, an annotation-efficient framework using only one annotated template case for segmentation. SemiSAM-O1 extends the specialist-generalist collaborative learning framework to the extreme one-label setting by fully exploiting the foundation model's feature representation capability beyond its prompting interface. SemiSAM-O1 operates in two stages. In the first stage, the foundation model's encoder extracts dense features from all volumes, and class prototypes derived from the single annotated template are propagated to the unlabeled pool via feature similarity to produce coarse initial pseudo-labels. In the second stage, an iterative training-and-refinement loop progressively improves both the segmentation model and the pseudo-labels over multiple rounds, where each round trains the model from scratch on current pseudo-labels and generates updated predictions with voxel-wise uncertainty estimates. An uncertainty-guided refinement step further leverages the foundation model's global feature space to correct high-uncertainty regions by aggregating labels from their most similar confident neighbors, establishing a virtuous cycle of mutual improvement. Extensive experiments on a wide range of segmentation tasks across different modalities and anatomical targets demonstrate that SemiSAM-O1 significantly narrows the performance gap between one-label semi-supervised learning and full supervision, while significantly reducing the computational overhead of online foundation model inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。