用Transformer融合多尺度特征,提升皮肤病变分割精度
ScaleFusionNet: Transformer-Guided Multi-Scale Feature Fusion for Skin Lesion Segmentation
- 结合Swin Transformer与交叉注意力机制,动态优化特征融合
- 在ISIC-2016和2018上分别达92.94%和91.80%的Dice分数
- 适合医学图像分割研究者,尤其关注边界精细分割场景
黑色素瘤是源于皮肤细胞的恶性肿瘤。准确高效的皮肤病变分割对定量分析至关重要,但受限于边界模糊、颜色渐变和形状不规则等挑战。为此,我们提出ScaleFusionNet,一种融合交叉注意力Transformer模块(CATM)与自适应融合块(AFB)的混合模型,以捕捉局部与全局特征,增强特征提取与融合能力。CATM利用Swin Transformer块与交叉注意力融合(CAF),自适应地优化编码器-解码器间的特征融合,减少语义差异。AFB则通过基于Swin Transformer的注意力机制与可变形卷积的并行路径,协同获取局部与全局上下文信息,有效细化病变边界并保留细粒度细节。在ISIC-2016与ISIC-2018数据集上,模型分别取得92.94%与91.80%的Dice分数,显著优于现有方法。独立验证实验在PH²数据集上进一步证实其优越性。代码已开源。
原文摘要 · Abstract (English)
Melanoma is a malignant tumor that originates from skin cell lesions. Accurate and efficient segmentation of skin lesions is essential for quantitative analysis but remains a challenge due to blurred lesion boundaries, gradual color changes, and irregular shapes. To address this, we propose ScaleFusionNet, a hybrid model that integrates a Cross-Attention Transformer Module (CATM) and adaptive fusion block (AFB) to enhance feature extraction and fusion by capturing both local and global features. We introduce CATM, which utilizes Swin transformer blocks and Cross Attention Fusion (CAF) to adaptively refine feature fusion and reduce semantic gaps in the encoder-decoder to improve segmentation accuracy. Additionally, the AFB uses Swin Transformer-based attention and deformable convolution-based adaptive feature extraction to help the model gather local and global contextual information through parallel pathways. This enhancement refines the lesion boundaries and preserves fine-grained details. ScaleFusionNet achieves Dice scores of 92.94\% and 91.80\% on the ISIC-2016 and ISIC-2018 datasets, respectively, demonstrating its effectiveness in skin lesion analysis. Simultaneously, independent validation experiments were conducted on the PH$^2$ dataset using the pretrained model weights. The results show that ScaleFusionNet demonstrates significant performance improvements compared with other state-of-the-art methods. Our code implementation is publicly available at GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。