数据增强影响糖尿病视网膜病变预测的可靠性,样本混合策略更优
Effect of Data Augmentation on Conformal Prediction for Diabetic Retinopathy
- 测试五种数据增强策略对置信预测性能的影响
- Mixup和CutMix提升准确率并改善不确定性估计效率
- 适合医疗影像中需可靠置信度的AI系统设计参考
深度学习模型在糖尿病视网膜病变(DR)分级等高风险任务中的临床应用,亟需可验证的可靠性。尽管模型精度高,但缺乏稳健的不确定性量化限制了其临床价值。共形预测(CP)提供无分布假设的框架,可生成具有统计覆盖率保证的预测集。然而,标准训练方法如数据增强与该保证有效性的关系尚不明确。本研究系统考察不同数据增强策略对DR分级共形预测性能的影响。基于DDR数据集,评估两种骨干网络——ResNet-50与Co-Scale Conv-Attentional Transformer(CoaT),在五种增强方案下:无增强、标准几何变换、CLAHE、Mixup和CutMix。分析下游共形指标,包括经验覆盖率、平均预测集大小和正确效率。结果表明,如Mixup和CutMix等样本混合策略不仅提高预测准确性,还带来更可靠且高效的不确定性估计;而CLAHE等方法可能降低模型置信度。研究强调应协同设计数据增强与下游不确定性量化,以构建真正可信的医学影像AI系统。
原文摘要 · Abstract (English)
The clinical deployment of deep learning models for high-stakes tasks such as diabetic retinopathy (DR) grading requires demonstrable reliability. While models achieve high accuracy, their clinical utility is limited by a lack of robust uncertainty quantification. Conformal prediction (CP) offers a distribution-free framework to generate prediction sets with statistical guarantees of coverage. However, the interaction between standard training practices like data augmentation and the validity of these guarantees is not well understood. In this study, we systematically investigate how different data augmentation strategies affect the performance of conformal predictors for DR grading. Using the DDR dataset, we evaluate two backbone architectures -- ResNet-50 and a Co-Scale Conv-Attentional Transformer (CoaT) -- trained under five augmentation regimes: no augmentation, standard geometric transforms, CLAHE, Mixup, and CutMix. We analyze the downstream effects on conformal metrics, including empirical coverage, average prediction set size, and correct efficiency. Our results demonstrate that sample-mixing strategies like Mixup and CutMix not only improve predictive accuracy but also yield more reliable and efficient uncertainty estimates. Conversely, methods like CLAHE can negatively impact model certainty. These findings highlight the need to co-design augmentation strategies with downstream uncertainty quantification in mind to build genuinely trustworthy AI systems for medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。