融合空间与序列特征,提升皮肤病变分割精度与效率
When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation
- 采用xLSTM-VMUNet模型联合捕捉图像的空间与序列特征
- 在ISIC2018数据集上DSC提升4.85%,IoU提升6.41%
- 适合需要高精度医学图像分割的研究与临床应用
自动黑色素瘤分割对早期皮肤癌检测至关重要,但受黑色素瘤异质性及模糊边界、低对比度和成像伪影等因素影响。现有方法多忽视皮肤病图像中空间与序列特征的联合建模,限制了分割精度,尤其在边界不清或结构相似的病例中表现不佳。同时,以往模型缺乏全局感受野且计算效率不高。本文提出xLSTM-VMUNet模型,成功联合捕捉皮肤病图像中的空间与序列特征。该模型不仅能有效提取病变结构特征,还能增强上下文理解,更优处理复杂医学图像。在ISIC2018数据集上的实验表明,xLSTM-VMUNet相比VMUNet在DSC上提升4.85%、IoU提升6.41%;在ISIC2017数据集上分别提升1.25%和2.07%,收敛更快,性能稳定。代码已开源。
原文摘要 · Abstract (English)
Automatic melanoma segmentation is essential for early skin cancer detection, yet challenges arise from the heterogeneity of melanoma, as well as interfering factors like blurred boundaries, low contrast, and imaging artifacts. While numerous algorithms have been developed to address these issues, previous approaches have often overlooked the need to jointly capture spatial and sequential features within dermatological images. This limitation hampers segmentation accuracy, especially in cases with indistinct borders or structurally similar lesions. Additionally, previous models lacked both a global receptive field and high computational efficiency. In this work, we present the xLSTM-VMUNet Model, which jointly capture spatial and sequential features within dermatological images successfully. xLSTM-VMUNet can not only specialize in extracting spatial features from images, focusing on the structural characteristics of skin lesions, but also enhance contextual understanding, allowing more effective handling of complex medical image structures. Experiment results on the ISIC2018 dataset demonstrate that xLSTM-VMUNet outperforms VMUNet by 4.85% on DSC and 6.41% on IoU on the ISIC2017 dataset, by 1.25% on DSC and 2.07% on IoU on the ISIC2018 dataset, with faster convergence and consistently high segmentation performance. Our code is available at https://github.com/FangZhuoyi/XLSTM-VMUNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。