对比12种模型在皮肤癌检测中的表现,找到最适合临床部署的方案。
CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection
- 统一评估四类模型:CNN、ViT、混合架构和视觉语言模型。
- 混合模型与SigLIP-VLM在准确率和临床指标上综合最优。
- 结果可复现,代码开源,指导真实筛查场景选型。
皮肤癌是全球范围内常见且快速上升的恶性肿瘤,早期检测对改善预后至关重要。基于皮肤镜和临床图像训练的深度学习模型可支持自动化快速分诊。然而,许多研究仅评估有限的模型架构,实验设置也差异显著。本文在PAD-UFES-20数据集上,对十二种深度学习模型进行统一评估,涵盖四类:卷积神经网络(CNN)、视觉变换器(ViT)、混合卷积-变压器骨干网络,以及视觉语言模型(VLM)。性能通过AUC、最大F1值及其对应的精确率与召回率,以及80%特异性下的敏感度进行评估,反映筛查需求。结果显示,经过调优的CNN已提供强基线,但基于Transformer的模型持续提升区分能力。混合模型(MaxViT Tiny、CoAtNet0)及基于SigLIP的VLM在排序性能与临床相关操作点之间取得最佳平衡,而基于CLIP的模型则具有高精确度。所有实验的完整代码库已公开。这些发现为皮肤癌筛查中模型的实际部署提供了实用指导,并为未来在PAD-UFES-20上的研究建立了可复现的基准。
原文摘要 · Abstract (English)
Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies evaluate only a limited set of architectures. Experimental setups also vary across studies. In this paper, we present a unified evaluation of twelve deep learning models for binary skin cancer detection on the PAD-UFES-20 dataset. The models span four families: convolutional neural networks (CNN), vision transformers (ViT), hybrid convolution transformer backbones, and vision language models (VLM). Performance is assessed using AUC, the maximum F1 score with its precision and recall, and sensitivity at 80% specificity, reflecting screening oriented requirements. Our results show that well tuned CNNs already provide strong baselines, but transformer based families consistently improve discrimination. Hybrid models (MaxViT Tiny, CoAtNet0) and a SigLIP based VLM achieve the best overall trade off between ranking performance and clinically relevant operating points, while CLIP based model offers high precision. The full codebase for all experiments is publicly released. Together, these findings offer practical guidance on which model families are most suitable for real world deployment in skin cancer screening and establish a reproducible reference point for future work on PAD-UFES-20.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。