提出动态分解MLP混合模块,提升医学图像分割的全局特征捕捉能力。
D2-MLP: Dynamic Decomposed MLP Mixer for Medical Image Segmentation
- 设计动态分解混合模块,分别处理通道与空间特征
- 在两个数据集上分割精度超越现有最优方法
- 适合需要精准分割的医学图像分析任务
卷积神经网络广泛应用于医学图像分割,但受限于卷积操作的局部性,难以自适应学习全局特征。相比之下,MLP Mixers虽能以低复杂度学习跨通道全局信息,却难以高效捕捉空间特征,且缺乏有效的自适应特征融合机制。为此,我们提出一种新型动态分解混合模块,通过创新的混合器结构,在不同空间位置和通道间提取并聚合特征;同时引入动态混合机制,建模通道与空间特征表示间的相互依赖关系,并实现自适应融合。随后,将该模块嵌入基于U型架构的Transformer网络,构建出新的动态分解MLP混合网络。在两个医学图像分割数据集上的实验表明,该方法性能优于当前主流方法。
原文摘要 · Abstract (English)
Convolutional neural networks are widely used in various segmentation tasks in medical images. However, they are challenged to learn global features adaptively due to the inherent locality of convolutional operations. In contrast, MLP Mixers are proposed as a backbone to learn global information across channels with low complexity. However, they cannot capture spatial features efficiently. Additionally, they lack effective mechanisms to fuse and mix features adaptively. To tackle these limitations, we propose a novel Dynamic Decomposed Mixer module. It is designed to employ novel Mixers to extract features and aggregate information across different spatial locations and channels. Additionally, it employs novel dynamic mixing mechanisms to model inter-dependencies between channel and spatial feature representations and to fuse them adaptively. Subsequently, we incorporate it into a U-shaped Transformer-based architecture to generate a novel network, termed the Dynamic Decomposed MLP Mixer. We evaluated it for medical image segmentation on two datasets, and it achieved superior segmentation performance than other state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。