融合卷积与Mamba,高效精准分割医学图像
MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation
- 用卷积捕捉纹理特征,Mamba建模长程依赖
- 在多类医学图像上超越现有最佳方法
- 适合需要高效高精度分割的医疗场景
医学图像分割在辅助诊断中至关重要。传统基于卷积的U型架构受限于局部感受野。视觉变压器因能捕捉全局上下文而广泛应用,但其非线性自注意力机制导致计算开销巨大。为解决此问题,选择状态空间模型(SSM)Mamba因其线性复杂度和高效内存使用而受到关注。本文提出MambaVesselNet++,一种混合CNN-Mamba架构用于医学图像分割。该模型包含混合图像编码器(Hi-Encoder)和双焦点融合解码器(BF-Decoder)。Hi-Encoder首先通过卷积设计纹理感知层以提取低级语义特征,再利用Mamba有效建模长程依赖。BF-Decoder通过跳跃连接融合编码器的局部与全局信息,生成精确分割掩码。大量实验表明,MambaVesselNet++在多种2D、3D及实例分割任务中均优于当前主流的卷积、变压器和Mamba基方法。代码已公开于https://github.com/CC0117/MambaVesselNet。
原文摘要 · Abstract (English)
Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely applied to diverse medical segmentation frameworks due to their superior capabilities of capturing global contexts. Despite the advantage, the real-world application of vision transformers is challenged by their non-linear self-attention mechanism, requiring huge computational costs. To address this issue, the selective state space model (SSM) Mamba has gained recognition for its adeptness in modeling long-range dependencies in sequential data, particularly noted for its efficient memory costs. In this paper, we propose MambaVesselNet++, a Hybrid CNN-Mamba framework for medical image segmentation. Our MambaVesselNet++ is comprised of a hybrid image encoder (Hi-Encoder) and a bifocal fusion decoder (BF-Decoder). In Hi-Encoder, we first devise the texture-aware layer to capture low-level semantic features by leveraging convolutions. Then, we utilize Mamba to effectively model long-range dependencies with linear complexity. The Bi-Decoder adopts skip connections to combine local and global information of the Hi-Encoder for the accurate generation of segmentation masks. Extensive experiments demonstrate that MambaVesselNet++ outperforms current convolution-based, transformer-based, and Mamba-based state-of-the-arts across diverse medical 2D, 3D, and instance segmentation tasks. The code is available at https://github.com/CC0117/MambaVesselNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。