混合卷积与注意力机制,提升不同医学影像的分割精度。
CFFormer: Cross CNN-Transformer Channel Attention and Spatial Feature Fusion for Improved Segmentation of Heterogeneous Medical Images
- 用双编码器融合局部与全局特征,增强对复杂纹理的感知。
- 在8个数据集上平均性能超越现有方法,边界分割更准确。
- 适合处理超声等低质医学图像,对噪声和对比度差有强鲁棒性。
医学图像分割在辅助诊断中至关重要。现有方法多依赖空间注意力突出感兴趣区域,但医疗成像设备限制导致图像异质性强,如超声图像常伴有斑点噪声、低分辨率及目标组织与背景对比度差,易造成边界误判。为此,我们提出一种混合卷积神经网络-注意力模型CFFormer,通过有效提取通道特征,增强模型对组织区域的识别能力。该架构包含两个关键模块:跨编码器通道注意力(CFCA)和跨空间特征融合(XFF)。采用双编码器结构,CNN编码器捕捉局部特征,Transformer编码器建模全局上下文。CFCA模块实现双编码器间通道特征的过滤与交互,XFF模块有效缓解空间特征间的语义差异,实现平滑融合。我们在涵盖五种模态的八个数据集上评估模型泛化能力,实验结果表明,本模型优于当前最先进方法,在异质医学图像上均保持高精度分割。代码已开源:https://github.com/JiaxuanFelix/CFFormer。
原文摘要 · Abstract (English)
Medical image segmentation plays an important role in computer-aided diagnosis. Existing methods mainly utilize spatial attention to highlight the region of interest. However, due to limitations of medical imaging devices, medical images exhibit significant heterogeneity, posing challenges for segmentation. Ultrasound images, for instance, often suffer from speckle noise, low resolution, and poor contrast between target tissues and background, which may lead to inaccurate boundary delineation. To address these challenges caused by heterogeneous image quality, we propose a hybrid CNN-Transformer model,called CFFormer, which leverages effective channel feature extraction to enhance the model' s ability to accurately identify tissue regions by capturing rich contextual information. The proposed architecture contains two key components: the Cross Feature Channel Attention (CFCA) module and the X-Spatial Feature Fusion (XFF) module. The model incorporates dual encoders, with the CNN encoder focusing on capturing local features and the Transformer encoder modeling global features. The CFCA module filters and facilitates interactions between the channel features from the two encoders, while the XFF module effectively reduces the significant semantic information differences in spatial features, enabling a smooth and cohesive spatial feature fusion. We evaluate our model across eight datasets covering five modalities to test its generalization capability. Experimental results demonstrate that our model outperforms current state-of-the-art methods and maintains accurate tissue region segmentation across heterogeneous medical image datasets. The code is available at https://github.com/JiaxuanFelix/CFFormer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。