轻量级多尺度网络提升医学图像分割精度,解决边界模糊问题。
LM-Net: A Light-weight and Multi-scale Network for Medical Image Segmentation
- 融合CNN与ViT优势,设计多分支轻量模块提取多尺度特征。
- 引入局部与全局注意力模块,同时捕捉细节纹理与上下文语义。
- 仅需4.66G FLOPs和5.4M参数,三数据集达领先性能。
当前医学图像分割方法在深入挖掘多尺度信息及有效结合局部细节纹理与全局上下文语义方面存在局限,导致过分割、欠分割和边界模糊。为解决这些问题,本文提出一种新型轻量级多尺度网络(LM-Net),融合卷积神经网络(CNN)与视觉变压器(ViT)的优势,提升分割精度。LM-Net采用轻量级多分支模块在同一层级捕获多尺度特征,并引入两个模块在不同层级同时提取局部细节纹理与全局上下文语义:局部特征变换器(LFT)利用局部窗口自注意力捕捉细节,全局特征变换器(GFT)通过全局自注意力捕获语义。两者结合实现局部与全局表示的互补,缓解分割边界模糊问题。在三个具有不同模态的公开数据集上进行大量实验,结果表明,该模型在保持仅4.66G FLOPs和5.4M参数的前提下,超越现有方法,达到当前最优表现,验证了其在多种医学图像分割任务中的有效性与适应性。
原文摘要 · Abstract (English)
Current medical image segmentation approaches have limitations in deeply exploring multi-scale information and effectively combining local detail textures with global contextual semantic information. This results in over-segmentation, under-segmentation, and blurred segmentation boundaries. To tackle these challenges, we explore multi-scale feature representations from different perspectives, proposing a novel, lightweight, and multi-scale architecture (LM-Net) that integrates advantages of both Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to enhance segmentation accuracy. LM-Net employs a lightweight multi-branch module to capture multi-scale features at the same level. Furthermore, we introduce two modules to concurrently capture local detail textures and global semantics with multi-scale features at different levels: the Local Feature Transformer (LFT) and Global Feature Transformer (GFT). The LFT integrates local window self-attention to capture local detail textures, while the GFT leverages global self-attention to capture global contextual semantics. By combining these modules, our model achieves complementarity between local and global representations, alleviating the problem of blurred segmentation boundaries in medical image segmentation. To evaluate the feasibility of LM-Net, extensive experiments have been conducted on three publicly available datasets with different modalities. Our proposed model achieves state-of-the-art results, surpassing previous methods, while only requiring 4.66G FLOPs and 5.4M parameters. These state-of-the-art results on three datasets with different modalities demonstrate the effectiveness and adaptability of our proposed LM-Net for various medical image segmentation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。