新模型精准分割心脏复杂结构,尤其擅长处理长距离切片连接。
RotCAtt-TransUNet++: Novel Deep Neural Network for Sophisticated Cardiac Segmentation
- 用旋转注意力捕捉多切片间连接,结合跨尺度跳跃连接建模全局上下文。
- 在4个心脏数据集和1个腹部数据集上均超越现有最优方法,冠状动脉分割近乎完美。
- 适合需要高精度心脏影像分割的研究者,尤其关注血管与心肌区分的临床场景。
心血管疾病仍是全球主要健康威胁,导致大量死亡。准确分割心脏医学影像对降低致死率至关重要。然而,现有最先进的神经网络(包括基于CNN和Transformer的方法)在实际应用中存在局限,无法有效捕捉切片间的连接关系以及切片内的信息。这一缺陷在包含复杂长程细节(如轴向视图中的冠状动脉)的数据集中尤为明显。此外,现有方法难以区分心肌与非心肌成分,导致“喷洒”现象。为此,我们提出RotCAtt-TransUNet++,一种专为复杂心脏结构分割设计的新架构。该方法通过编码器中的嵌套跳跃连接聚合多尺度特征,并引入Transformer层以捕捉块间交互,同时采用旋转注意力机制捕获多切片间的连通性(即切片间信息)。此外,通道级交叉注意力门控融合多尺度通道信息,弥合解码阶段语义差距。实验表明,所提模型在四个心脏数据集和一个腹部数据集上均优于现有最先进方法。重要的是,推断时冠状动脉与心肌的标注几乎达到完美精度。消融实验证明,旋转注意力机制能有效在语义空间中转换嵌入的矢量化块,显著提升分割准确率。
原文摘要 · Abstract (English)
Cardiovascular disease remains a predominant global health concern, responsible for a significant portion of mortality worldwide. Accurate segmentation of cardiac medical imaging data is pivotal in mitigating fatality rates associated with cardiovascular conditions. However, existing state-of-the-art (SOTA) neural networks, including both CNN-based and Transformer-based approaches, exhibit limitations in practical applicability due to their inability to effectively capture inter-slice connections alongside intra-slice information. This deficiency is particularly evident in datasets featuring intricate, long-range details along the z-axis, such as coronary arteries in axial views. Additionally, SOTA methods fail to differentiate non-cardiac components from myocardium in segmentation, leading to the "spraying" phenomenon. To address these challenges, we present RotCAtt-TransUNet++, a novel architecture tailored for robust segmentation of complex cardiac structures. Our approach emphasizes modeling global contexts by aggregating multiscale features with nested skip connections in the encoder. It integrates transformer layers to capture interactions between patches and employs a rotatory attention mechanism to capture connectivity between multiple slices (inter-slice information). Additionally, a channel-wise cross-attention gate guides the fused multi-scale channel-wise information and features from decoder stages to bridge semantic gaps. Experimental results demonstrate that our proposed model outperforms existing SOTA approaches across four cardiac datasets and one abdominal dataset. Importantly, coronary arteries and myocardium are annotated with near-perfect accuracy during inference. An ablation study shows that the rotatory attention mechanism effectively transforms embedded vectorized patches in the semantic dimensional space, enhancing segmentation accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。