通过分层知识蒸馏提升冠脉分割精度,解决模型泛化差问题。
Deep Self-knowledge Distillation: A hierarchical supervised learning for coronary artery segmentation
- 利用分层输出进行监督,结合分布与像素级损失
- 在XCAD和DCA1数据集上各项指标均优于现有方法
- 适合医学图像分割与模型优化研究者参考
冠状动脉疾病是导致死亡的主要原因,精确诊断依赖于X射线血管造影。手动分割耗时且效率低,推动了自动化模型的发展。然而,现有基于规则或深度学习的方法普遍存在性能不佳、泛化能力有限的问题。当前知识蒸馏方法未充分挖掘模型的层次化知识,造成信息浪费,难以有效提升分割性能。为此,本文提出深度自知识蒸馏(Deep Self-knowledge Distillation),一种用于冠状动脉分割的新方法,通过利用分层输出进行监督。该方法结合深度分布损失与像素级自知识蒸馏损失,采用分层学习策略,实现教师模型到学生模型的知识迁移。通过松散约束的概率分布向量与紧密约束的像素级监督相结合,为分割模型提供双重正则化,增强其泛化性与鲁棒性。在XCAD和DCA1数据集上的大量实验表明,该方法在骰子系数、准确率、敏感性和交并比等指标上均优于其他模型。
原文摘要 · Abstract (English)
Coronary artery disease is a leading cause of mortality, underscoring the critical importance of precise diagnosis through X-ray angiography. Manual coronary artery segmentation from these images is time-consuming and inefficient, prompting the development of automated models. However, existing methods, whether rule-based or deep learning models, struggle with issues like poor performance and limited generalizability. Moreover, current knowledge distillation methods applied in this field have not fully exploited the hierarchical knowledge of the model, leading to certain information waste and insufficient enhancement of the model's performance capabilities for segmentation tasks. To address these issues, this paper introduces Deep Self-knowledge Distillation, a novel approach for coronary artery segmentation that leverages hierarchical outputs for supervision. By combining Deep Distribution Loss and Pixel-wise Self-knowledge Distillation Loss, our method enhances the student model's segmentation performance through a hierarchical learning strategy, effectively transferring knowledge from the teacher model. Our method combines a loosely constrained probabilistic distribution vector with tightly constrained pixel-wise supervision, providing dual regularization for the segmentation model while also enhancing its generalization and robustness. Extensive experiments on XCAD and DCA1 datasets demonstrate that our approach outperforms the dice coefficient, accuracy, sensitivity and IoU compared to other models in comparative evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。