用Mamba模型提升医学影像分割在分布偏移下的泛化能力
Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation
- 基于全局到局部序列增强,抑制模型对特定医院数据的依赖
- 在前列腺数据集上实现90%以上Dice系数,超越此前最优88.61%
- 首个探索Mamba用于医学图像分割泛化的框架,适合跨中心医疗应用
为应对医学图像分割中的分布偏移问题,领域泛化(DG)成为训练模型在源域上并推广至未见目标域的有前景方法。现有DG方法主要基于CNN或ViT架构。近期,状态空间模型(如Mamba)在多种监督式医学图像分割任务中表现出色,其优势在于能以线性复杂度捕捉长程依赖,是CNN和ViT的有力替代。受此启发,本文探索Mamba架构在医学图像分割领域泛化中的潜力,提出新型Mamba框架Mamba-Sea,引入全局到局部序列增强机制以提升模型在分布偏移下的泛化性能。全局层面,设计一种模拟不同医疗机构外观差异的增强机制,抑制模型学习领域特异性信息;局部层面,提出沿输入序列的分段增强方式,通过建模并重采样与领域偏移相关的风格统计量,扰动连续子序列中令牌的风格。据我们所知,Mamba-Sea是首个探索Mamba在医学图像分割泛化中应用的工作,提供了一个强鲁棒性的先进架构。显著的是,该方法首次在Prostate数据集上实现超过90%的Dice系数,超越此前最优结果88.61%。代码已公开于https://github.com/orange-czh/Mamba-Sea。
原文摘要 · Abstract (English)
To segment medical images with distribution shifts, domain generalization (DG) has emerged as a promising setting to train models on source domains that can generalize to unseen target domains. Existing DG methods are mainly based on CNN or ViT architectures. Recently, advanced state space models, represented by Mamba, have shown promising results in various supervised medical image segmentation. The success of Mamba is primarily owing to its ability to capture long-range dependencies while keeping linear complexity with input sequence length, making it a promising alternative to CNNs and ViTs. Inspired by the success, in the paper, we explore the potential of the Mamba architecture to address distribution shifts in DG for medical image segmentation. Specifically, we propose a novel Mamba-based framework, Mamba-Sea, incorporating global-to-local sequence augmentation to improve the model's generalizability under domain shift issues. Our Mamba-Sea introduces a global augmentation mechanism designed to simulate potential variations in appearance across different sites, aiming to suppress the model's learning of domain-specific information. At the local level, we propose a sequence-wise augmentation along input sequences, which perturbs the style of tokens within random continuous sub-sequences by modeling and resampling style statistics associated with domain shifts. To our best knowledge, Mamba-Sea is the first work to explore the generalization of Mamba for medical image segmentation, providing an advanced and promising Mamba-based architecture with strong robustness to domain shifts. Remarkably, our proposed method is the first to surpass a Dice coefficient of 90% on the Prostate dataset, which exceeds previous SOTA of 88.61%. The code is available at https://github.com/orange-czh/Mamba-Sea.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。