用模型置信度融合多张眼底图,提升糖尿病视网膜病变筛查准确率。
Model Confidence-Guided Multi-Image Fusion of Fundus Images for Diabetic Retinopathy Diagnosis
- 根据模型置信度筛选图像,动态决定是否重拍,避免低可信度诊断。
- 在mBRSET和BRSET数据集上平衡准确率达91%和97%,比传统方法高6%-12%。
- 适合资源有限地区的移动端筛查,单次推理轻量高效,易部署。
早期眼病筛查对医疗资源有限的中低收入国家至关重要。本文提出一种基于置信度引导的多图融合框架,通过整合多个视网膜图像提升诊断置信度与平衡准确率。该方法利用模型置信度识别不可靠预测,并在必要时触发重拍。我们对比了三种方案:(1) 单图像的级联质量筛选与诊断流水线,(2) 基于置信度的预测,(3) 本研究提出的置信度引导多图融合。所有方法均基于RETFoundGreen主干网络,在mBRSET(n=1,234)和BRSET(n=7,599)数据集上评估。结果表明,在70%覆盖率下,本方法在mBRSET上达到91%平衡准确率,BRSET上达97%,分别较级联过滤提升约12%和6%。级联质量筛选在mBRSET和BRSET上的灵敏度分别为61%和86%,而本框架在50%覆盖率下分别达到94%和96%。结论:人工标注的质量标签与诊断性能弱相关,基于置信度的过滤始终优于基于图像质量的级联流程。本框架可实现更可靠诊断,减少误诊。其轻量化主干与每图单次推理特性,使其适用于低延迟移动筛查系统。
原文摘要 · Abstract (English)
Purpose: Early screening for eye diseases is critical in low- and middle-income countries where access to care is limited. We investigate whether a confidence-guided, multi-image diabetic retinopathy diagnosis framework can integrate image filtering with confidence-aware predictions for reliable screening at capture. Methods: We develop a multi-image fusion method that aggregates retinal views to improve confidence and balanced accuracy. Our method uses confidence to identify unreliable predictions, prompting retakes when needed. We compare: (1) a cascaded image-quality and disease diagnosis pipeline using a single image per patient, (2) confidence-based prediction, and (3) our confidence-based multi-image fusion pipeline. All methods are evaluated using a RETFoundGreen backbone on the mBRSET (n = 1,234) and BRSET (n = 7,599) datasets. Results: At 70% coverage, our method achieves 91% balanced accuracy on mBRSET and 97% on BRSET, improvements of ~12% and ~6%, respectively, over cascade filtering. The image-quality cascade reaches sensitivities of 61% on mBRSET and 86% on BRSET, whereas our framework reaches 94% and 96%, respectively, at 50% coverage. Conclusions: Human-annotated quality labels are weakly associated with diagnostic performance, and confidence-based filtering consistently outperforms image quality-based cascaded pipelines. Translational Relevance: Using confidence-based multi-image fusion, patients receive more reliable predictions, reducing incorrect diagnoses during screening. The lightweight backbone and single inference pass per image make the framework compatible with low-latency mobile screening systems in resource-limited settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。