融合Mamba与多注意力机制,提升医学图像分割精度与效率
MambaCAFU: Hybrid Multi-Scale and Multi-Attention Model with Mamba-Based Fusion for Medical Image Segmentation
- 三分支编码器结合CNN、Transformer与Mamba融合注意力
- 在多个数据集上达到更高分割精度,且计算开销可控
- 适合需要高效高精度的临床医学图像分析场景
近年来,深度学习在复杂医学组织和肿瘤分割中已接近专家水平。然而,现有模型往往任务特定,跨模态和解剖区域性能差异大,模型复杂度与性能平衡仍具挑战,尤其在对准确性和效率要求并重的临床环境中。为此,我们提出一种混合分割架构,采用三分支编码器,集成卷积神经网络(CNN)、Transformer与基于Mamba的注意力融合(MAF)机制,以捕捉局部、全局及长程依赖关系。一个多尺度注意力驱动的CNN解码器重建细粒度分割图,同时保持上下文一致性。此外,共注意力门通过强化编码与解码阶段跨尺度的空间与语义信息,提升特征选择与跨尺度交互能力。在多个基准数据集上的大量实验表明,该方法在精度与泛化能力上优于当前最优模型,同时维持相近的计算复杂度。通过有效平衡效率与效果,该架构为多样化的医学影像任务提供了实用且可扩展的解决方案。源代码与训练模型将在论文接受后公开,以支持可复现性与后续研究。
原文摘要 · Abstract (English)
In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions. Balancing model complexity and performance remains challenging, particularly in clinical settings where both accuracy and efficiency are critical. To address these issues, we propose a hybrid segmentation architecture featuring a three-branch encoder that integrates CNNs, Transformers, and a Mamba-based Attention Fusion (MAF) mechanism to capture local, global, and long-range dependencies. A multi-scale attention-based CNN decoder reconstructs fine-grained segmentation maps while preserving contextual consistency. Additionally, a co-attention gate enhances feature selection by emphasizing relevant spatial and semantic information across scales during both encoding and decoding, improving feature interaction and cross-scale communication. Extensive experiments on multiple benchmark datasets show that our approach outperforms state-of-the-art methods in accuracy and generalization, while maintaining comparable computational complexity. By effectively balancing efficiency and effectiveness, our architecture offers a practical and scalable solution for diverse medical imaging tasks. Source code and trained models will be publicly released upon acceptance to support reproducibility and further research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。