arXiv:2409.00346cs.CV2024-09中稿 · IEEE BIBM 2024被引 59

SMAFormer融合多注意力机制,提升小病灶与器官的医学图像分割精度。

SMAFormer: Synergistic Multi-Attention Transformer for Medical Image Segmentation

  • 设计协同多注意力模块,整合像素、通道与空间注意力增强特征表达。
  • 在肝脏和膀胱肿瘤分割任务中达到当前最优性能,显著提升小目标分割效果。
  • 适合需要精准分割微小病灶的临床医学图像分析场景。

在医学图像分割中,基于注意力机制的Transformer与带跳跃连接的残差网络等计算机视觉技术显著提升了性能。然而,现有模型在分割小型、不规则形状肿瘤时仍表现不佳。为此,本文提出SMAFormer,一种高效的Transformer架构,通过融合多种注意力机制,提升对小肿瘤及器官的分割能力。该架构包含两个核心组件:首先,提出协同多注意力(SMA)Transformer模块,融合像素注意力、通道注意力与空间注意力以丰富特征表达;其次,为缓解注意力机制转换与特征融合过程中的信息损失,设计了特征融合调制器,通过减少重排导致的信息损耗,增强通道与空间注意力间的融合效果。我们在多个医学图像分割任务上进行了广泛实验,涵盖多器官、肝脏肿瘤与膀胱肿瘤分割,均取得当前最优结果。代码与模型已公开于:https://github.com/lzeeorno/SMAFormer。

原文摘要 · Abstract (English)

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless, previous models often falter when segmenting small, irregularly shaped tumors. To this end, we introduce SMAFormer, an efficient, Transformer-based architecture that fuses multiple attention mechanisms for enhanced segmentation of small tumors and organs. SMAFormer can capture both local and global features for medical image segmentation. The architecture comprises two pivotal components. First, a Synergistic Multi-Attention (SMA) Transformer block is proposed, which has the benefits of Pixel Attention, Channel Attention, and Spatial Attention for feature enrichment. Second, addressing the challenge of information loss incurred during attention mechanism transitions and feature fusion, we design a Feature Fusion Modulator. This module bolsters the integration between the channel and spatial attention by mitigating reshaping-induced information attrition. To evaluate our method, we conduct extensive experiments on various medical image segmentation tasks, including multi-organ, liver tumor, and bladder tumor segmentation, achieving state-of-the-art results. Code and models are available at: https://github.com/lzeeorno/SMAFormer.

医学图像分割Transformer注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。