提出新型解码器,兼顾局部细节与长程依赖,提升医学图像分割精度。
MACMD: Multi-dilated Contextual Attention and Channel Mixer Decoding for Medical Image Segmentation
- 引入多膨胀卷积与注意力调制,增强上下文建模能力
- 跨通道混合模块提升编码器与解码器间信息融合效率
- 在多器官分割任务中超越现有方法,兼具高精度与低计算量
医学图像分割面临解剖结构差异带来的挑战。虽然卷积神经网络(CNN)能有效捕捉局部特征,但难以建模长程依赖;而变压器通过自注意力机制缓解此问题,却缺乏对局部上下文的保留能力。当前主流模型多采用编码器-解码器架构,但仍存在两个关键局限:(1) 浅层虽能捕捉细粒度细节,但随着数据深入深层,信息逐渐丢失;(2) 编码器与解码器阶段间局部细节与全局上下文的整合效率低下。为此,本文提出基于MACMD的解码器,通过跳跃连接实现编码器与解码器间的通道混合,并结合分层膨胀卷积、注意力驱动调制和交叉通道混合模块,在保持局部细节的同时捕获长程依赖,对精确分割至关重要。我们在多个变压器编码器上评估了该方法,在二分类与多器官分割任务中均取得优于当前最优方法的骰子分数,且计算效率更高,验证了其在准确性和鲁棒性方面的有效性。代码已公开于https://github.com/lalitmaurya47/MACMD。
原文摘要 · Abstract (English)
Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers mitigate this issue with self-attention mechanisms but lack the ability to preserve local contextual information. State-of-the-art models primarily follow an encoder-decoder architecture, achieving notable success. However, two key limitations remain: (1) Shallow layers, which are closer to the input, capture fine-grained details but suffer from information loss as data propagates through deeper layers. (2) Inefficient integration of local details and global context between the encoder and decoder stages. To address these challenges, we propose the MACMD-based decoder, which enhances attention mechanisms and facilitates channel mixing between encoder and decoder stages via skip connections. This design leverages hierarchical dilated convolutions, attention-driven modulation, and a cross channel-mixing module to capture long-range dependencies while preserving local contextual details, essential for precise medical image segmentation. We evaluated our approach using multiple transformer encoders on both binary and multi-organ segmentation tasks. The results demonstrate that our method outperforms state-of-the-art approaches in terms of Dice score and computational efficiency, highlighting its effectiveness in achieving accurate and robust segmentation performance. The code available at https://github.com/lalitmaurya47/MACMD
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。