融合大卷积核与自注意力,提升医学图像分割的局部与全局特征捕捉能力。
TransLK-Net: Entangling Transformer and Large Kernel for Progressive and Collaborative Feature Encoding and Decoding in Medical Image Segmentation
- 设计双模块:分层捕获多尺度局部特征与高效建模全局上下文。
- 通过注意力纠缠机制实现局部与全局特征的渐进式协同增强。
- 适合需要高精度分割的三维医学影像任务,如肿瘤定位与器官建模。
卷积神经网络(CNN)和视觉变换器(ViT)广泛用于医学图像分割,但各自存在固有缺陷。CNN受限于固定大小卷积核,难以捕捉多尺度特征和全局上下文信息;而ViT虽能建模全局信息,却缺乏空间局部特征学习能力,且自注意力计算复杂度高。为此,本文提出渐进式纠缠变换器大卷积核(PTLK)与协同纠缠变换器大卷积核(CTLK)模块,融合自注意力与大卷积核优势。PTLK与CTLK采用多头大卷积核捕获多尺度局部特征,利用高效分解自注意力高效建模全局信息,并通过注意力纠缠机制使局部与全局特征逐步相互增强与校准。此外,提出注意力门控通道MLP(AG-MLP)模块,赋予标准MLP建模空间信息的能力。上述模块集成至跨纠缠解码(CED)块中,实现高效特征融合与解码。最终构建基于编码器-解码器架构的TransLK-Net网络,其编码器采用分层ViT结构,每个块由PTLK、CTLK与AG-MLP组成,解码器使用CED块。
原文摘要 · Abstract (English)
Convolutional neural networks (CNNs) and vision transformers (ViTs) are widely employed for medical image segmentation, but they are still challenged by their intrinsic characteristics. CNNs are limited from capturing varying-scaled features and global contextual information due to the employment of fixed-sized kernels. In contrast, ViTs employ self-attention and MLP for global information modeling, but they lack mechanisms to learn spatial-wise local information. Additionally, self-attention leads the network to show high computational complexity. To tackle these limitations, we propose Progressively Entangled Transformer Large Kernel (PTLK) and Collaboratively Entangled Transformer Large Kernel (CTLK) modules to leverage the benefits of self-attention and large kernel convolutions and overcome shortcomings. Specifically, PTLK and CTLK modules employ the Multi-head Large Kernel to capture multi-scale local features and the Efficient Decomposed Self-attention to model global information efficiently. Subsequently, they employ the Attention Entanglement mechanism to enable local and global features to enhance and calibrate each other progressively and collaboratively. Additionally, an Attention-gated Channel MLP (AG-MLP) module is proposed to equip the standard MLP module with the capabilities of modeling spatial information. PTLK and CTLK modules are further incorporated as a Cross Entanglement Decoding (CED) block for efficient feature fusion and decoding. Finally, we propose a novel network for volumetric medical image segmentation that employs an encoder-decoder architecture, termed TransLK-Net. The encoder employs a hierarchical ViT architecture whose block is built by incorporating PTLK and CTLK with AG-MLP into a ViT block, and the decoder employs the CED block.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。