用线性注意力和Mamba机制提升医学图像分割效率与精度
MLLA-UNet: Mamba-like Linear Attention in an Efficient U-Shape Model for Medical Image Segmentation
- 采用线性注意力与类Mamba自适应机制,实现线性计算复杂度
- 在6个数据集24项任务上平均Dice系数达88.32%,性能领先
- 适合需要高效高精度分割的医疗影像研究者使用
医学影像日益复杂,面临解剖结构变异大、组织边界模糊、器官对比度低和噪声等问题。传统分割方法难以应对,深度学习尤其是U型架构逐渐成为主流。然而,标准自注意力的二次计算复杂度使Transformer在高分辨率图像上难以应用。为此,我们提出MLLA-UNet(类Mamba线性注意力U型网络),通过创新结合线性注意力与类Mamba自适应机制,在保持高分割精度的同时实现线性计算复杂度,并引入高效的对称采样结构以增强特征处理能力。该架构有效保留关键空间特征,同时以低复杂度捕捉长程依赖。此外,提出新型多尺度特征融合采样策略。实验表明,MLLA-UNet在六个挑战性数据集的24项分割任务中表现卓越,包括FLARE22、AMOS CT和ACDC,平均Dice系数达88.32%。结果证明其优于现有方法。贡献包括新2D分割架构及其实证验证。代码已开源:https://github.com/csyfjiang/MLLA-UNet。
原文摘要 · Abstract (English)
Recent advancements in medical imaging have resulted in more complex and diverse images, with challenges such as high anatomical variability, blurred tissue boundaries, low organ contrast, and noise. Traditional segmentation methods struggle to address these challenges, making deep learning approaches, particularly U-shaped architectures, increasingly prominent. However, the quadratic complexity of standard self-attention makes Transformers computationally prohibitive for high-resolution images. To address these challenges, we propose MLLA-UNet (Mamba-Like Linear Attention UNet), a novel architecture that achieves linear computational complexity while maintaining high segmentation accuracy through its innovative combination of linear attention and Mamba-inspired adaptive mechanisms, complemented by an efficient symmetric sampling structure for enhanced feature processing. Our architecture effectively preserves essential spatial features while capturing long-range dependencies at reduced computational complexity. Additionally, we introduce a novel sampling strategy for multi-scale feature fusion. Experiments demonstrate that MLLA-UNet achieves state-of-the-art performance on six challenging datasets with 24 different segmentation tasks, including but not limited to FLARE22, AMOS CT, and ACDC, with an average DSC of 88.32%. These results underscore the superiority of MLLA-UNet over existing methods. Our contributions include the novel 2D segmentation architecture and its empirical validation. The code is available via https://github.com/csyfjiang/MLLA-UNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。