融合卷积与注意力机制,提升医学图像分割精度与效率
MSLAU-Net: A Hybrid CNN-Transformer Network for Medical Image Segmentation
- 设计多尺度线性注意力模块,低开销建模长距离依赖
- 采用自顶向下特征聚合,恢复空间分辨率并增强多尺度表达
- 在三种模态数据上优于主流方法,适合临床精准分割场景
精准的医学图像分割对于治疗规划、手术导航和疾病监测至关重要。基于卷积神经网络(CNN)和基于Transformer的方法在医学图像分割任务中均取得显著进展。然而,CNN难以有效捕捉全局上下文信息,而Transformer则存在局部特征建模不足及自注意力机制带来的高计算复杂度问题。为此,本文提出一种新型混合架构MSLAU-Net,融合两者优势。该模型引入多尺度线性注意力模块,高效提取多尺度特征并以低计算开销建模长距离依赖;同时采用自顶向下特征聚合机制,通过轻量化结构实现多层级特征融合与空间分辨率恢复。在涵盖三种成像模态的基准数据集上的大量实验表明,所提MSLAU-Net在几乎所有评价指标上均超越现有先进方法,验证了其优越性、有效性和鲁棒性。代码已公开于https://github.com/Monsoon49/MSLAU-Net。
原文摘要 · Abstract (English)
Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and Transformer-based methods have achieved remarkable success in medical image segmentation tasks. However, CNN-based methods struggle to effectively capture global contextual information due to the inherent limitations of convolution operations. Meanwhile, Transformer-based methods suffer from insufficient local feature modeling and face challenges related to the high computational complexity caused by the self-attention mechanism. To address these limitations, we propose a novel hybrid CNN-Transformer architecture, named MSLAU-Net, which integrates the strengths of both paradigms. The proposed MSLAU-Net incorporates two key ideas. First, it introduces Multi-Scale Linear Attention, designed to efficiently extract multi-scale features from medical images while modeling long-range dependencies with low computational complexity. Second, it adopts a top-down feature aggregation mechanism, which performs multi-level feature aggregation and restores spatial resolution using a lightweight structure. Extensive experiments conducted on benchmark datasets covering three imaging modalities demonstrate that the proposed MSLAU-Net outperforms other state-of-the-art methods on nearly all evaluation metrics, validating the superiority, effectiveness, and robustness of our approach.Our code is available at https://github.com/Monsoon49/MSLAU-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。