arXiv:2412.15526cs.CV2024-12中稿 · AAAI被引 14

仅需标注少量切片,实现精准医学图像分割。

SGTC: Semantic-Guided Triplet Co-training for Sparsely Annotated Semi-Supervised Medical Image Segmentation

  • 利用CLIP预训练模型引导语义分割,提升伪标签质量。
  • 仅用三张切片标注,仍达顶尖分割性能。
  • 适合标注资源稀缺的临床医学场景。

尽管半监督学习在医学图像分割领域取得显著进展,但逐切片完全标注体积样本仍成本高昂且耗时。现有方法多关注图像级信息而忽略语义特征,难以感知弱边界。为此,本文提出一种新型语义引导三元组协同训练(SGTC)框架,仅需标注少数体积样本的三个正交切片,显著减轻放射科医生负担。该方法包含两个核心组件:首先,基于预训练CLIP设计语义引导辅助学习机制,实现细粒度语义感知分割并提升伪标签质量;其次,针对更具挑战性但临床更真实的场景,提出三视图差异协同训练策略,利用稀疏标注(即仅三张标记切片)驱动三个子网络协同优化,大幅增强模型鲁棒性。在三个公开医学数据集上的大量实验表明,本方法在稀疏标注条件下优于多数前沿半监督方法。代码已开源:https://github.com/xmeimeimei/SGTC。

原文摘要 · Abstract (English)

Although semi-supervised learning has made significant advances in the field of medical image segmentation, fully annotating a volumetric sample slice by slice remains a costly and time-consuming task. Even worse, most of the existing approaches pay much attention to image-level information and ignore semantic features, resulting in the inability to perceive weak boundaries. To address these issues, we propose a novel Semantic-Guided Triplet Co-training (SGTC) framework, which achieves high-end medical image segmentation by only annotating three orthogonal slices of a few volumetric samples, significantly alleviating the burden of radiologists. Our method consist of two main components. Specifically, to enable semantic-aware, fine-granular segmentation and enhance the quality of pseudo-labels, a novel semantic-guided auxiliary learning mechanism is proposed based on the pretrained CLIP. In addition, focusing on a more challenging but clinically realistic scenario, a new triple-view disparity training strategy is proposed, which uses sparse annotations (i.e., only three labeled slices of a few volumes) to perform co-training between three sub-networks, significantly improving the robustness. Extensive experiments on three public medical datasets demonstrate that our method outperforms most state-of-the-art semi-supervised counterparts under sparse annotation settings. The source code is available at https://github.com/xmeimeimei/SGTC.

医学图像分割半监督学习弱标注CLIP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。