用有序交叉熵提升医疗预测的准确性和临床合理性。
Deep Neural Networks with Ordinal Loss for Medical Applications

- 引入有序交叉熵损失,考虑类别间严重程度差异的误判代价。
- 在多个基准数据集上误差成本更低,校准性更优。
- 适合需区分疾病严重程度的医疗诊断任务。
在许多医疗预测问题中,目标标签具有内在的有序结构,类别顺序反映临床意义的严重程度。误判的代价通常是非均匀且不对称的:远距离类别的误判后果远重于相邻类别之间的误判,且高估与低估疾病严重程度的临床影响不同。传统多分类交叉熵损失将所有误判视为等价,未能利用这种有序信息。近期有序回归方法通过将排序结构融入深度学习模型来解决此问题。本文提出一种通用且架构无关的 extbf{有序交叉熵(OCE)}框架,扩展标准交叉熵以通过有序代价矩阵体现误判严重性,同时保持概率解释和优化优势。我们提供了OCE梯度行为的理论分析,证明其带来更平滑的优化动态和更好的有序一致性。在基准数据集上的实验表明,该方法比现有先进有序方法获得更低的预测误差成本和更优的校准性能,确立了OCE作为深度神经网络中有序回归的简单而有效的解决方案。
原文摘要 · Abstract (English)
In many prediction problems in medical applications, target labels exhibit an inherent ordinal structure, where class ordering reflects clinically meaningful severity levels. The cost associated with misclassification is often non-uniform and asymmetric, as errors between distant ordinal categories may have substantially more severe consequences than errors between adjacent ones, and overestimating disease severity may have different clinical implications than underestimating it. Traditional loss functions such as multi-class cross-entropy treat all misclassifications equally and fail to incorporate this ordering information. Recent advances in ordinal regression aim to address this limitation by integrating rank-based structures into deep learning models. In this work, we introduce the \textbf{Ordinal Cross-Entropy (OCE)} framework, a general and architecture-independent approach for learning from ordinal data. The proposed method extends the standard cross-entropy formulation to account for misclassification severity through an ordinal cost matrix while preserving the probabilistic interpretation and optimization benefits of the conventional loss. We provide a theoretical analysis of the OCE gradient behavior and show that it yields smoother optimization dynamics and improved ordinal consistency. Experiments on benchmark datasets show that our method achieves lower prediction error costs and better calibration compared to existing state-of-the-art ordinal approaches, establishing OCE as a simple yet effective solution for ordinal regression in deep neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。