融合CNN与Mamba的轻量级分割模型,提升医学图像精度与效率。
ACM-UNet: Adaptive Integration of CNNs and Mamba for Efficient Medical Image Segmentation
- 用轻量适配器融合预训练CNN和Mamba,解决结构不匹配问题。
- 在Synapse上达85.12% Dice,HD95为13.89mm,仅需17.93G FLOPs。
- 适合需要高精度且计算资源有限的医学图像分割场景。
U型编码器-解码器结构凭借其简洁与高效已成为医学图像分割的主流范式。尽管近期研究通过设计更强的编码器和解码器、引入先进CNN提取局部特征、使用Transformer或状态空间模型(如Mamba)建模全局上下文,或两者的混合组合来改进该框架,但这些方法常因结构不匹配而难以有效利用预训练视觉骨干网络(如ResNet、ViT、VMamba)。为此,我们提出ACM-UNet,一种通用分割框架,在保持简单UNet结构的同时,通过轻量适配器机制有效整合预训练CNN与Mamba模型。该适配器解决了架构不兼容问题,使模型能够发挥CNN与SSM的互补优势——即细粒度局部细节提取与长程依赖建模。此外,我们在解码器中引入分层多尺度小波变换模块,增强特征融合与重建保真度。在Synapse和ACDC基准上的大量实验表明,ACM-UNet达到当前最优性能,同时保持计算高效。尤其在Synapse数据集上,取得85.12% Dice Score与13.89mm HD95,仅需17.93G FLOPs,展现出其有效性与可扩展性。代码已开源:https://github.com/zyklcode/ACM-UNet。
原文摘要 · Abstract (English)
The U-shaped encoder-decoder architecture with skip connections has become a prevailing paradigm in medical image segmentation due to its simplicity and effectiveness. While many recent works aim to improve this framework by designing more powerful encoders and decoders, employing advanced convolutional neural networks (CNNs) for local feature extraction, Transformers or state space models (SSMs) such as Mamba for global context modeling, or hybrid combinations of both, these methods often struggle to fully utilize pretrained vision backbones (e.g., ResNet, ViT, VMamba) due to structural mismatches. To bridge this gap, we introduce ACM-UNet, a general-purpose segmentation framework that retains a simple UNet-like design while effectively incorporating pretrained CNNs and Mamba models through a lightweight adapter mechanism. This adapter resolves architectural incompatibilities and enables the model to harness the complementary strengths of CNNs and SSMs-namely, fine-grained local detail extraction and long-range dependency modeling. Additionally, we propose a hierarchical multi-scale wavelet transform module in the decoder to enhance feature fusion and reconstruction fidelity. Extensive experiments on the Synapse and ACDC benchmarks demonstrate that ACM-UNet achieves state-of-the-art performance while remaining computationally efficient. Notably, it reaches 85.12% Dice Score and 13.89mm HD95 on the Synapse dataset with 17.93G FLOPs, showcasing its effectiveness and scalability. Code is available at: https://github.com/zyklcode/ACM-UNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。