为疾病严重程度分类设计新损失函数,提升模型判别力与临床可解释性。
Class Distance Weighted Cross Entropy Loss for Classification of Disease Severity
- 基于类别距离加权交叉熵,远距离误分类惩罚更强。
- 在多个模型上显著提升轮廓系数与AUC值,优于传统及已有序损失。
- 生成的注意力图更聚焦临床关键区域,专家评价认可度高。
对具有有序类别的疾病严重程度评估任务,传统交叉熵损失表现不佳。本文提出新型损失函数——类别距离加权交叉熵(CDW-CE),对预测与真实类别距离较远的错误给予更高惩罚。我们在多种深度网络结构上验证该方法,对比了多种分类与有序损失函数。通过t-SNE和UMAP可视化分析潜在表示质量,采用轮廓系数量化聚类效果,并比较了使用CDW-CE与交叉熵训练模型生成的类激活图(CAM)。结合领域专家反馈,评估模型注意力与临床判断的一致性。结果表明,CDW-CE在有序图像分类任务中持续提升性能:轮廓系数更高,表明类别区分能力更强;其生成的CAM更聚焦于临床相关区域,且经专家验证一致。受试者工作特征曲线(ROC)与曲线下面积(AUC)显示,该方法优于其他损失函数,包括文献中知名有序损失。
原文摘要 · Abstract (English)
Assessing disease severity with ordinal classes, where each class reflects increasing severity levels, benefits from loss functions designed for this ordinal structure. Traditional categorical loss functions, like Cross-Entropy (CE), often perform suboptimally in these scenarios. To address this, we propose a novel loss function, Class Distance Weighted Cross-Entropy (CDW-CE), which penalizes misclassifications more severely when the predicted and actual classes are farther apart. We evaluated CDW-CE using various deep architectures, comparing its performance against several categorical and ordinal loss functions. To assess the quality of latent representations, we used t-distributed stochastic neighbor embedding (t-SNE) and uniform manifold approximation and projection (UMAP) visualizations, quantified the clustering quality using the Silhouette Score, and compared Class Activation Maps (CAM) generated by models trained with CDW-CE and CE loss. Feedback from domain experts was incorporated to evaluate how well model attention aligns with expert opinion. Our results show that CDW-CE consistently improves performance in ordinal image classification tasks. It achieves higher Silhouette Scores, indicating better class discrimination capability, and its CAM visualizations show a stronger focus on clinically significant regions, as validated by domain experts. Receiver operator characteristics (ROC) curves and the area under the curve (AUC) scores highlight that CDW-CE outperforms other loss functions, including prominent ordinal loss functions from the literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。