通过多维度多样性增强,提升半监督医学图像分割性能
Diversity-enhanced Collaborative Mamba for Semi-supervised Medical Image Segmentation
- 引入跨数据、网络、特征的多样性设计,利用Mamba长程建模优势
- 在Synapse数据集20%标注下达到83.69%平均Dice,领先现有方法6.69%
- 适合需要少样本标注的医学图像分割研究者使用
获取高质量标注的医学图像分割数据既耗时又昂贵。半监督分割技术通过利用未标注数据生成伪标签来缓解这一问题。近年来,以Mamba为代表的先进状态空间模型展现出对长程依赖的高效处理能力,这促使我们探索其在半监督医学图像分割中的潜力。本文提出一种新颖的多样性增强协同Mamba框架(简称DCMamba),从数据、网络和特征三个视角挖掘并利用多样性。首先,在数据层面,设计了结合Mamba扫描特性的块级弱-强混合增强;其次,在网络层面,引入多样扫描协同模块,利用不同扫描方向带来的预测差异;再次,在特征层面,采用不确定性加权对比学习机制,增强特征表示的多样性。实验表明,所提DCMamba显著优于其他半监督医学图像分割方法,例如在20%标注数据条件下,于Synapse数据集上较最新SSM基线方法提升6.69%。
原文摘要 · Abstract (English)
Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space models, represented by Mamba, have shown efficient handling of long-range dependencies. This drives us to explore their potential in semi-supervised medical image segmentation. In this paper, we propose a novel Diversity-enhanced Collaborative Mamba framework (namely DCMamba) for semi-supervised medical image segmentation, which explores and utilizes the diversity from data, network, and feature perspectives. Firstly, from the data perspective, we develop patch-level weak-strong mixing augmentation with Mamba's scanning modeling characteristics. Moreover, from the network perspective, we introduce a diverse-scan collaboration module, which could benefit from the prediction discrepancies arising from different scanning directions. Furthermore, from the feature perspective, we adopt an uncertainty-weighted contrastive learning mechanism to enhance the diversity of feature representation. Experiments demonstrate that our DCMamba significantly outperforms other semi-supervised medical image segmentation methods, e.g., yielding the latest SSM-based method by 6.69% on the Synapse dataset with 20% labeled data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。