arXiv:2410.01003cs.CV2024-10被引 1

融合卷积与注意力机制,提升医学体积图像分割精度

Y-CA-Net: A Convolutional Attention Based Network for Volumetric Medical Image Segmentation

  • 并行使用卷积与变换器提取局部和全局特征
  • 在多器官分割任务中达82.4%的Dice分数,优于基线模型
  • 适用于需要精细结构识别的医学影像分析场景

近期基于注意力的体积分割方法在医学领域表现出色,聚焦于建模长距离依赖。然而,对于体素级预测任务,判别性局部特征对分割性能至关重要,而现有注意力方法缺乏此类特征。为此,本文设计了将卷积编码器分支与变换器主干结合的结构,以并行方式提取局部与全局特征,并通过交叉特征混合模块(CFMM)进行融合,从而提升分割掩码预测效果。由此得到的Y-CT-Net在多个医学分割任务中表现优异,例如在多器官分割任务中获得82.4%的Dice分数,较精心调参的基线模型UNETR和ResNet-3D分别提升2.9%和1.4%。在此基础上,进一步扩展为混合注意力模型Y-CH-Net,使相同任务的HD95评分提升3%。实验验证了该思路的有效性,推动提出通用架构Y-CA-Net,其基于任意两个编码器与解码器结构,充分挖掘卷积与注意力机制的互补优势。结果表明,Y-CA-Net是实现体积分割优越性能的关键架构。

原文摘要 · Abstract (English)

Recent attention-based volumetric segmentation (VS) methods have achieved remarkable performance in the medical domain which focuses on modeling long-range dependencies. However, for voxel-wise prediction tasks, discriminative local features are key components for the performance of the VS models which is missing in attention-based VS methods. Aiming at resolving this issue, we deliberately incorporate the convolutional encoder branch with transformer backbone to extract local and global features in a parallel manner and aggregate them in Cross Feature Mixer Module (CFMM) for better prediction of segmentation mask. Consequently, we observe that the derived model, Y-CT-Net, achieves competitive performance on multiple medical segmentation tasks. For example, on multi-organ segmentation, Y-CT-Net achieves an 82.4% dice score, surpassing well-tuned VS Transformer/CNN-like baselines UNETR/ResNet-3D by 2.9%/1.4%. With the success of Y-CT-Net, we extend this concept with hybrid attention models, that derived Y-CH-Net model, which brings a 3% improvement in terms of HD95 score for same segmentation task. The effectiveness of both models Y-CT-Net and Y-CH-Net verifies our hypothesis and motivates us to initiate the concept of Y-CA-Net, a versatile generic architecture based upon any two encoders and a decoder backbones, to fully exploit the complementary strengths of both convolution and attention mechanisms. Based on experimental results, we argue Y-CA-Net is a key player in achieving superior results for volumetric segmentation.

医学图像体积分割注意力机制卷积网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。