arXiv:2503.19308cs.CV2025-03被引 13

Mamba在3D医学图像分割中表现优于Transformer,效率更高

A Comprehensive Analysis of Mamba for 3D Volumetric Medical Image Segmentation

  • 用U形结构+3D深度卷积增强Mamba,提升性能
  • 多尺度Mamba块在细节与全局上下文捕捉上更优
  • 简单扫描策略常够用,复杂方法仅在难题中占优

Mamba通过选择性状态空间模型(SSMs)在长程依赖建模上比Transformer更具计算效率。然而其在高分辨率3D医学图像分割中的有效性仍存争议。本研究通过三个核心问题展开全面分析:能否替代Transformer?能否提升多尺度表征学习?复杂扫描是否必要?我们在AMOS、TotalSegmentator和BraTS三个大型公开基准上评估了Mamba性能。结果表明,基于U形结构的UlikeMamba网络,在引入定制3D深度卷积后,持续优于UlikeTrans(U形Transformer基线),显著提升精度与效率。所提出的多尺度Mamba模块在复杂分割任务中同时捕捉精细细节与全局上下文,表现超越同类Transformer架构。我们还评估了复杂扫描策略,发现简单方法通常足够,而提出的Tri-scan在最挑战场景中具明显优势。结合上述改进,我们构建新网络,使Mamba在精度上媲美nnUNet、CoTr、U-Mamba等领先模型,同时具备更优计算效率。本研究揭示了Mamba的独特优势,为3D医学成像提供更高效精准的新路径。

原文摘要 · Abstract (English)

Mamba, with its selective State Space Models (SSMs), offers a more computationally efficient solution than Transformers for long-range dependency modeling. However, there is still a debate about its effectiveness in high-resolution 3D medical image segmentation. In this study, we present a comprehensive investigation into Mamba's capabilities in 3D medical image segmentation by tackling three pivotal questions: Can Mamba replace Transformers? Can it elevate multi-scale representation learning? Is complex scanning necessary to unlock its full potential? We evaluate Mamba's performance across three large public benchmarks-AMOS, TotalSegmentator, and BraTS. Our findings reveal that UlikeMamba, a U-shape Mamba-based network, consistently surpasses UlikeTrans, a U-shape Transformer-based network, particularly when enhanced with custom-designed 3D depthwise convolutions, boosting accuracy and computational efficiency. Further, our proposed multi-scale Mamba block demonstrates superior performance in capturing both fine-grained details and global context, especially in complex segmentation tasks, surpassing Transformer-based counterparts. We also critically assess complex scanning strategies, finding that simpler methods often suffice, while our Tri-scan approach delivers notable advantages in the most challenging scenarios. By integrating these advancements, we introduce a new network for 3D medical image segmentation, positioning Mamba as a transformative force that outperforms leading models such as nnUNet, CoTr, and U-Mamba, offering competitive accuracy with superior computational efficiency. This study provides key insights into Mamba's unique advantages, paving the way for more efficient and accurate approaches to 3D medical imaging.

3D分割Mamba医学影像高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。