arXiv:2502.09931cs.CVcs.AI2025-02被引 2

用图神经网络增强医学图像分割的跳跃连接,提升精度与效率。

TransGUNet: Transformer Meets Graph-based Skip Connection for Medical Image Segmentation

  • 将跨尺度特征转为图结构,通过节点注意力捕捉解剖关系。
  • 在6个已见和8个未见数据集上表现领先,计算更高效。
  • 结合熵驱动特征筛选,改善空间注意力质量,适合多模态医学分割。

跳跃连接主要用于缓解编码器与解码器之间的语义鸿沟,并整合全局依赖以理解复杂解剖结构的关系。尽管已有模型提出基于Transformer的方法在跳跃连接中引入全局依赖,但往往难以捕捉细节局部特征且计算复杂度高。相比之下,图神经网络(GNN)能有效捕捉局部与全局特征。为此,我们提出一种注意力式跨尺度图神经网络(ACS-GNN),将跨尺度特征图转化为图结构,通过节点注意力捕捉复杂解剖结构。此外,我们发现深度学习模型常生成信息量低的特征图,导致空间注意力图质量下降。为此,我们引入熵驱动特征选择(EFS),为每个通道计算熵值并过滤高熵特征图。所提出的TransGUNet框架融合ACS-GNN与基于EFS的空间注意力机制,通过结合GNN与可靠的空间注意力图,显著提升跨模态的领域泛化能力,确保跳跃连接中特征的鲁棒性。综合实验表明,TransGUNet在6个已见和8个未见数据集上均取得优异分割性能,且相比先前方法具有显著更高的效率。

原文摘要 · Abstract (English)

Skip connection engineering is primarily employed to address the semantic gap between the encoder and decoder, while also integrating global dependencies to understand the relationships among complex anatomical structures in medical image segmentation. Although several models have proposed transformer-based approaches to incorporate global dependencies within skip connections, they often face limitations in capturing detailed local features with high computational complexity. In contrast, graph neural networks (GNNs) exploit graph structures to effectively capture local and global features. Leveraging these properties, we introduce an attentional cross-scale graph neural network (ACS-GNN), which enhances the skip connection framework by converting cross-scale feature maps into a graph structure and capturing complex anatomical structures through node attention. Additionally, we observed that deep learning models often produce uninformative feature maps, which degrades the quality of spatial attention maps. To address this problem, we integrated entropy-driven feature selection (EFS) with spatial attention, calculating an entropy score for each channel and filtering out high-entropy feature maps. Our innovative framework, TransGUNet, comprises ACS-GNN and EFS-based spatial attentio} to effectively enhance domain generalizability across various modalities by leveraging GNNs alongside a reliable spatial attention map, ensuring more robust features within the skip connection. Through comprehensive experiments and analysis, TransGUNet achieved superior segmentation performance on six seen and eight unseen datasets, demonstrating significantly higher efficiency compared to previous methods.

医学图像图神经网络分割注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。