arXiv:2510.17773cs.CVcs.AI2025-10被引 2

用分割+临床信息融合,让皮肤癌诊断更准更可信

Towards Explainable Skin Cancer Classification: A Dual-Network Attention Model with Lesion Segmentation and Clinical Metadata Fusion

  • 双网络注意力机制,融合病变分割图与患者信息
  • 在HAM10000等数据集上准确率与AUC均达领先水平
  • 热力图验证模型关注病灶区,避免误判背景特征

皮肤癌是威胁生命的疾病,早期检测可显著改善预后。基于皮肤镜图像的自动诊断因类内差异大、类间差异微弱而困难,且多数深度学习模型为“黑箱”,影响临床信任。本文提出一种双编码器注意力框架,结合病变分割图与患者临床信息(年龄、性别、病灶部位),提升分类准确率与可解释性。首先采用含双重注意力门与空洞空间金字塔池化的Deep-UNet进行病变分割;分类阶段使用两路DenseNet201编码器——一路处理原始图像,另一路处理分割后的病变区域,通过多头交叉注意力融合特征,引导模型聚焦关键病灶。此外,引入Transformer模块整合临床元数据。在HAM10000及ISIC 2018、2019挑战赛数据集上评估,所提方法实现最先进的分割性能,并显著提升分类准确率与平均AUC。通过梯度加权类激活映射(Grad-CAM)生成热力图,验证模型预测依赖于病变区域,而非干扰性背景特征。结果表明,结合精准分割与临床数据的注意力融合策略,可构建更准确、可解释的皮肤癌分类模型。

原文摘要 · Abstract (English)

Skin cancer is a life-threatening disease where early detection significantly improves patient outcomes. Automated diagnosis from dermoscopic images is challenging due to high intra-class variability and subtle inter-class differences. Many deep learning models operate as "black boxes," limiting clinical trust. In this work, we propose a dual-encoder attention-based framework that leverages both segmented lesions and clinical metadata to enhance skin lesion classification in terms of both accuracy and interpretability. A novel Deep-UNet architecture with Dual Attention Gates (DAG) and Atrous Spatial Pyramid Pooling (ASPP) is first employed to segment lesions. The classification stage uses two DenseNet201 encoders-one on the original image and another on the segmented lesion whose features are fused via multi-head cross-attention. This dual-input design guides the model to focus on salient pathological regions. In addition, a transformer-based module incorporates patient metadata (age, sex, lesion site) into the prediction. We evaluate our approach on the HAM10000 dataset and the ISIC 2018 and 2019 challenges. The proposed method achieves state-of-the-art segmentation performance and significantly improves classification accuracy and average AUC compared to baseline models. To validate our model's reliability, we use Gradient-weighted Class Activation Mapping (Grad-CAM) to generate heatmaps. These visualizations confirm that our model's predictions are based on the lesion area, unlike models that rely on spurious background features. These results demonstrate that integrating precise lesion segmentation and clinical data with attention-based fusion leads to a more accurate and interpretable skin cancer classification model.

皮肤癌可解释性注意力机制医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。