提升糖尿病视网膜病变分级模型在新数据上的泛化能力
Divergent Domains, Convergent Grading: Enhancing Generalization in Diabetic Retinopathy Grading
- 根据病变等级生成诊断相关的眼底图像增强数据
- 新提出的域对齐损失使同类别特征在各域中收敛到同一流形
- 结合焦点损失与自监督预训练,应对标签噪声与数据不均衡
糖尿病视网膜病变(DR)导致全球5%的失明病例。尽管已有大量深度学习方法试图改进传统DR分级,但在面对分布外数据时常表现不佳,限制了其广泛应用。本文提出一种新的深度学习方法以实现DR分级中的域泛化(DG)。首先,提出一种基于原始眼底图像分级的图像到图像诊断相关增强方法,模拟不同数据集间的变异,提升模型鲁棒性。其次,针对标准分类损失在DR域泛化中的不足,提出专用的域对齐损失,确保同一类别在所有域中的特征向量收敛至同一流形,从而改善泛化性能。第三,为解决不同域和类别间的数据不平衡问题,引入焦点损失(Focal loss),并可无缝集成至新提出的对齐损失中。第四,鉴于医生诊断中固有的观察者差异带来的标签噪声,提出利用自监督预训练,使模型在仅有少量非DR眼底图像可用于预训练的情况下仍能抵抗早期标签噪声影响。实验表明,该方法显著优于强基线ERM及其他最新SOTA域泛化方法。代码已开源:https://github.com/sharonchokuwa/dg-adr。
原文摘要 · Abstract (English)
Diabetic Retinopathy (DR) constitutes 5% of global blindness cases. While numerous deep learning approaches have sought to enhance traditional DR grading methods, they often falter when confronted with new out-of-distribution data thereby impeding their widespread application. In this study, we introduce a novel deep learning method for achieving domain generalization (DG) in DR grading and make the following contributions. First, we propose a new way of generating image-to-image diagnostically relevant fundus augmentations conditioned on the grade of the original fundus image. These augmentations are tailored to emulate the types of shifts in DR datasets thus increase the model's robustness. Second, we address the limitations of the standard classification loss in DG for DR fundus datasets by proposing a new DG-specific loss, domain alignment loss; which ensures that the feature vectors from all domains corresponding to the same class converge onto the same manifold for better domain generalization. Third, we tackle the coupled problem of data imbalance across DR domains and classes by proposing to employ Focal loss which seamlessly integrates with our new alignment loss. Fourth, due to inevitable observer variability in DR diagnosis that induces label noise, we propose leveraging self-supervised pretraining. This approach ensures that our DG model remains robust against early susceptibility to label noise, even when only a limited dataset of non-DR fundus images is available for pretraining. Our method demonstrates significant improvements over the strong Empirical Risk Minimization baseline and other recently proposed state-of-the-art DG methods for DR grading. Code is available at https://github.com/sharonchokuwa/dg-adr.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。