arXiv:2409.07779cs.CVcs.AI2024-09被引 1

提出自适应融合网络,提升微肿瘤与多器官分割精度。

AFFSegNet: Adaptive Feature Fusion Segmentation Network for Microtumors and Multi-Organ Segmentation

  • 用多尺度注意力融合局部与全局特征
  • 在多个数据集上达到当前最佳性能
  • 适合医学图像分割研究者参考

医学图像分割在计算机视觉中至关重要,可自动勾画解剖结构和病灶,辅助临床诊断、治疗规划与疾病监测。尽管基于移位窗口自注意力的变压器表现优异,但其依赖局部窗口注意力,难以融合局部与全局上下文信息,影响微肿瘤和微型器官的分割效果。为此,我们提出自适应语义分割网络(ASSNet),一种能有效整合局部与全局特征的变压器架构。ASSNet采用基于变压器的U形编码器-解码器结构:编码器在五种分辨率下使用移位窗口自注意力提取多尺度特征,并通过跳跃连接传递至解码器。我们在编码器中引入增强型多层感知机,显式建模长距离依赖。针对传统对称编码器-解码器设计的局限性,提出自适应特征融合(AFF)解码器,包含长距离依赖(LRD)块、多尺度特征融合(MFF)块和自适应语义中心(ASC)块,协同实现解码器多尺度特征的有效融合,捕捉长距离依赖并精炼物体边界。在多器官、肝肿瘤和膀胱肿瘤分割等多样任务上的全面实验表明,ASSNet取得当前最优结果。代码与模型已公开于: https://github.com/lzeeorno/ASSNet。

原文摘要 · Abstract (English)

Medical image segmentation, a crucial task in computer vision, facilitates the automated delineation of anatomical structures and pathologies, supporting clinicians in diagnosis, treatment planning, and disease monitoring. Notably, transformers employing shifted window-based self-attention have demonstrated exceptional performance. However, their reliance on local window attention limits the fusion of local and global contextual information, crucial for segmenting microtumors and miniature organs. To address this limitation, we propose the Adaptive Semantic Segmentation Network (ASSNet), a transformer architecture that effectively integrates local and global features for precise medical image segmentation. ASSNet comprises a transformer-based U-shaped encoder-decoder network. The encoder utilizes shifted window self-attention across five resolutions to extract multi-scale features, which are then propagated to the decoder through skip connections. We introduce an augmented multi-layer perceptron within the encoder to explicitly model long-range dependencies during feature extraction. Recognizing the constraints of conventional symmetrical encoder-decoder designs, we propose an Adaptive Feature Fusion (AFF) decoder to complement our encoder. This decoder incorporates three key components: the Long Range Dependencies (LRD) block, the Multi-Scale Feature Fusion (MFF) block, and the Adaptive Semantic Center (ASC) block. These components synergistically facilitate the effective fusion of multi-scale features extracted by the decoder while capturing long-range dependencies and refining object boundaries. Comprehensive experiments on diverse medical image segmentation tasks, including multi-organ, liver tumor, and bladder tumor segmentation, demonstrate that ASSNet achieves state-of-the-art results. Code and models are available at: \url{https://github.com/lzeeorno/ASSNet}.

医学图像分割变压器特征融合微肿瘤

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。