用变换器提取皮肤病变图像的统计纹理特征,提升分割精度。
SkinFormer: Learning Statistical Texture Representation with Transformer for Skin Lesion Segmentation
- 设计柯西度引导的统计计数算子,量化输入特征的全局纹理统计
- 在ISIC 2018数据集上达到93.2%的Dice分数,优于当前最优方法
- 适合需要高精度皮肤病变分割的医学影像研究者使用
从皮肤镜图像中准确分割皮肤病变对皮肤癌诊断至关重要。然而,由于难以将有用的纹理表示融入学习过程,黑色素瘤的自动分割仍具挑战性。纹理不仅包含卷积神经网络学习的局部结构信息,还涉及输入图像的全局统计纹理信息。本文提出一种Transformer网络(SkinFormer),高效提取并融合统计纹理表示以实现皮肤病变分割。具体地,为量化输入特征的统计纹理,设计了柯西度引导的统计计数算子;借助该算子,提出统计纹理融合Transformer与统计纹理增强Transformer,利用Transformer的全局注意力机制融合结构纹理与统计纹理,并增强多尺度特征的统计纹理。在三个公开皮肤病变数据集上的大量实验表明,SkinFormer优于其他最先进方法,在ISIC 2018数据集上取得93.2%的Dice分数。未来可轻松扩展至3D图像分割。代码已开源。
原文摘要 · Abstract (English)
Accurate skin lesion segmentation from dermoscopic images is of great importance for skin cancer diagnosis. However, automatic segmentation of melanoma remains a challenging task because it is difficult to incorporate useful texture representations into the learning process. Texture representations are not only related to the local structural information learned by CNN, but also include the global statistical texture information of the input image. In this paper, we propose a trans\textbf{Former} network (\textbf{SkinFormer}) that efficiently extracts and fuses statistical texture representation for \textbf{Skin} lesion segmentation. Specifically, to quantify the statistical texture of input features, a Kurtosis-guided Statistical Counting Operator is designed. We propose Statistical Texture Fusion Transformer and Statistical Texture Enhance Transformer with the help of Kurtosis-guided Statistical Counting Operator by utilizing the transformer's global attention mechanism. The former fuses structural texture information and statistical texture information, and the latter enhances the statistical texture of multi-scale features. {Extensive experiments on three publicly available skin lesion datasets validate that our SkinFormer outperforms other SOAT methods, and our method achieves 93.2\% Dice score on ISIC 2018. It can be easy to extend SkinFormer to segment 3D images in the future.} Our code is available at https://github.com/Rongtao-Xu/SkinFormer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。