用自适应机制提升医学图像分割,少标注也能高精度。
Autoadaptive Medical Segment Anything Model

- 用辅助分类器的激活图引导分割分支,实现半监督学习
- 在标注极少时,分割精度比基线高出10%以上
- 适合临床数据少、标注成本高的医学影像场景
医学图像分割是影像流程中的关键任务,影响诸多基于影像的决策。传统全监督分割模型依赖大量人工标注数据,过程昂贵、耗时且易出错,亟需高效、自动、少标注的训练方法。我们提出ADA-SAM(自动化、领域自适应的分割一切模型),一种基于多任务学习的医学图像分割框架,利用辅助分类器的类别激活图指导基于Segment Anything(SAM)架构的半监督分割分支。此外,模型引入新型梯度反馈机制,通过分割分支的梯度反向优化分类预测,建立可学习的跨分支连接。我们在康复试验中收集的真实临床数据上验证了该方法,在标注受限条件下,分割性能显著优于全监督与半监督基线,提升幅度达双位数。代码已开源:https://github.com/tbwa233/ADA-SAM。
原文摘要 · Abstract (English)
Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual annotation, which can be an expensive, time-consuming, and error-prone process. This signals a need for accurate, automatic, and annotation-efficient methods of training these models. We propose ADA-SAM (automated, domain-specific, and adaptive segment anything model), a novel multitask learning framework for medical image segmentation that leverages class activation maps from an auxiliary classifier to guide the predictions of the semi-supervised segmentation branch, which is based on the Segment Anything (SAM) framework. Additionally, our ADA-SAM model employs a novel gradient feedback mechanism to create a learnable connection between the segmentation and classification branches by using the segmentation gradients to guide and improve the classification predictions. We validate ADA-SAM on real-world clinical data collected during rehabilitation trials, and demonstrate that our proposed method outperforms both fully-supervised and semi-supervised baselines by double digits in limited label settings. Our code is available at: https://github.com/tbwa233/ADA-SAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。