融合门控卷积与Mamba的新型3D医学图像分割模型
MambaClinix: Hierarchical Gated Convolution and Mamba-Based U-Net for Enhanced 3D Medical Image Segmentation
- 用分层门控卷积替代注意力机制,高效建模空间关系
- 在5个数据集上实现高精度分割,模型复杂度低
- 适合需要兼顾精度与推理速度的临床影像分析
深度学习,尤其是卷积神经网络(CNN)和Transformer,在3D医学图像分割中取得显著进展。虽然CNN擅长捕捉局部特征,但其感受野有限,可能影响复杂临床场景下的表现;而Transformer虽能建模长程依赖,却计算成本高昂。近期提出的基于状态空间模型(SSM)的Mamba架构,可在保持线性计算复杂度的前提下高效建模长程依赖,但在医学图像分割中仍难以有效捕捉关键局部特征。为此,本文提出MambaClinix,一种新型U型架构,将分层门控卷积网络(HGCN)与Mamba结合于自适应阶段式框架中,显著提升计算效率与高阶空间交互能力,可同时捕捉医学图像中的近邻与远距离关系。具体而言,所设计的HGCN通过纯卷积结构模拟Transformer的注意力机制,实现特征图中的高阶空间交互,避免了传统Transformer方法的计算开销。此外,引入区域特异性Tversky损失,强化特定像素区域的分割表现,优化模型决策过程。在五个基准数据集上的实验结果表明,该模型在保持低模型复杂度的同时实现了高分割精度。
原文摘要 · Abstract (English)
Deep learning, particularly convolutional neural networks (CNNs) and Transformers, has significantly advanced 3D medical image segmentation. While CNNs are highly effective at capturing local features, their limited receptive fields may hinder performance in complex clinical scenarios. In contrast, Transformers excel at modeling long-range dependencies but are computationally intensive, making them expensive to train and deploy. Recently, the Mamba architecture, based on the State Space Model (SSM), has been proposed to efficiently model long-range dependencies while maintaining linear computational complexity. However, its application in medical image segmentation reveals shortcomings, particularly in capturing critical local features essential for accurate delineation of clinical regions. In this study, we propose MambaClinix, a novel U-shaped architecture for medical image segmentation that integrates a hierarchical gated convolutional network(HGCN) with Mamba in an adaptive stage-wise framework. This design significantly enhances computational efficiency and high-order spatial interactions, enabling the model to effectively capture both proximal and distal relationships in medical images. Specifically, our HGCN is designed to mimic the attention mechanism of Transformers by a purely convolutional structure, facilitating high-order spatial interactions in feature maps while avoiding the computational complexity typically associated with Transformer-based methods. Additionally, we introduce a region-specific Tversky loss, which emphasizes specific pixel regions to improve auto-segmentation performance, thereby optimizing the model's decision-making process. Experimental results on five benchmark datasets demonstrate that the proposed MambaClinix achieves high segmentation accuracy while maintaining low model complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。