arXiv:2409.02018cs.CVcs.AI2024-09被引 2

提出双注意力结构,提升医学图像分割精度与效率。

TransDAE: Dual Attention Mechanism in a Hierarchical Transformer for Efficient Medical Image Segmentation

  • 引入空间与通道双重注意力机制,捕捉全局依赖关系。
  • 在Synaps数据集上超越现有方法,无需预训练权重。
  • 适合追求高精度医学图像分割的科研与临床应用。

在医疗领域,医学图像分割对于精准疾病诊断和有效治疗策略开发至关重要。早期检测有助于疾病管理并可能阻止其进展。机器学习,尤其是深度卷积神经网络,已成为应对分割挑战的有前景方法。传统方法如U-Net使用编码块建模局部特征,解码块揭示语义关系,但常难以处理纹理和形状变化大的多尺度物体,且难以捕捉输入数据中的长程依赖。为应对这些局限,本文提出TransDAE:一种重新设计自注意力机制的方法,同时在完整特征空间中建模空间与通道级关联,保持计算高效。此外,通过引入跨尺度交互模块增强跳跃连接路径,促进特征复用,提升定位精度。实验表明,TransDAE在Synaps多器官数据集上优于现有最先进方法,即使不依赖预训练权重。

原文摘要 · Abstract (English)

In healthcare, medical image segmentation is crucial for accurate disease diagnosis and the development of effective treatment strategies. Early detection can significantly aid in managing diseases and potentially prevent their progression. Machine learning, particularly deep convolutional neural networks, has emerged as a promising approach to addressing segmentation challenges. Traditional methods like U-Net use encoding blocks for local representation modeling and decoding blocks to uncover semantic relationships. However, these models often struggle with multi-scale objects exhibiting significant variations in texture and shape, and they frequently fail to capture long-range dependencies in the input data. Transformers designed for sequence-to-sequence predictions have been proposed as alternatives, utilizing global self-attention mechanisms. Yet, they can sometimes lack precise localization due to insufficient granular details. To overcome these limitations, we introduce TransDAE: a novel approach that reimagines the self-attention mechanism to include both spatial and channel-wise associations across the entire feature space, while maintaining computational efficiency. Additionally, TransDAE enhances the skip connection pathway with an inter-scale interaction module, promoting feature reuse and improving localization accuracy. Remarkably, TransDAE outperforms existing state-of-the-art methods on the Synaps multi-organ dataset, even without relying on pre-trained weights.

医学图像分割注意力机制Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。