用带丢弃的SegFormer精准分割皮肤镜图像中的毛发,提升癌症检测前处理质量。
SegFormer Fine-Tuning with Dropout: Advancing Hair Artifact Removal in Skin Lesion Analysis
- 在SegFormer分割头加入0.3丢弃率,防止过拟合
- 平均Dice系数达0.96,IoU为0.93,重建质量高
- 适合需要高精度毛发去除的皮肤癌辅助诊断场景
皮肤镜图像中的毛发伪影严重影响皮肤病变分析的准确性,可能遮挡关键诊断特征。本文提出一种引入丢弃正则化的微调SegFormer模型,实现精确的毛发掩码分割。所提SegformerWithDropout架构采用MiT-B2编码器(预训练于ImageNet),通道数为3,输出类别数为2,分割头中设置0.3的丢弃概率以抑制过拟合。模型在包含500张皮肤病变图像及精细毛发标注的专用数据集上训练,采用10折交叉验证,使用AdamW优化器(学习率0.001)与交叉熵损失函数,基于验证损失进行早停(耐心3轮,最多20轮/折)。评估指标包括交并比(IoU)、Dice系数、峰值信噪比(PSNR)、结构相似性指数(SSIM)和感知图像补丁相似性(LPIPS)。交叉验证结果表明,模型性能稳定:平均Dice系数约0.96,IoU达0.93,同时具备良好的重建质量(PSNR约34 dB,SSIM 0.97,LPIPS低至0.06),证明其在毛发伪影分割中的有效性,可有效提升下游皮肤癌检测任务的预处理效果。
原文摘要 · Abstract (English)
Hair artifacts in dermoscopic images present significant challenges for accurate skin lesion analysis, potentially obscuring critical diagnostic features in dermatological assessments. This work introduces a fine-tuned SegFormer model augmented with dropout regularization to achieve precise hair mask segmentation. The proposed SegformerWithDropout architecture leverages the MiT-B2 encoder, pretrained on ImageNet, with an in-channel count of 3 and 2 output classes, incorporating a dropout probability of 0.3 in the segmentation head to prevent overfitting. Training is conducted on a specialized dataset of 500 dermoscopic skin lesion images with fine-grained hair mask annotations, employing 10-fold cross-validation, AdamW optimization with a learning rate of 0.001, and cross-entropy loss. Early stopping is applied based on validation loss, with a patience of 3 epochs and a maximum of 20 epochs per fold. Performance is evaluated using a comprehensive suite of metrics, including Intersection over Union (IoU), Dice coefficient, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Learned Perceptual Image Patch Similarity (LPIPS). Experimental results from the cross-validation demonstrate robust performance, with average Dice coefficients reaching approximately 0.96 and IoU values of 0.93, alongside favorable PSNR (around 34 dB), SSIM (0.97), and low LPIPS (0.06), highlighting the model's effectiveness in accurate hair artifact segmentation and its potential to enhance preprocessing for downstream skin cancer detection tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。