融合多个眼科基础模型,提升眼病与系统疾病诊断准确率
FusionFM: Fusing Eye-specific Foundational Models for Optimized Ophthalmic Diagnosis
- 设计双融合策略,整合多个眼科基础模型以增强诊断能力
- RetiZero在多种疾病上表现最优,尤其在外部数据集泛化性强
- 对高血压等系统性疾病预测仍有挑战,适合临床研究者参考
基础模型(FMs)在医学影像分析中展现出优异的跨任务泛化能力。在眼科领域,尽管已有多个基础模型出现,但关于哪个模型最优、是否在所有任务中表现一致,以及是否可融合仍不明确。本研究首次系统评估单个与融合的眼科基础模型。提出FusionFM框架,包含两种融合方法,覆盖青光眼、糖尿病视网膜病变、年龄相关性黄斑变性等眼病检测,以及基于视网膜影像的糖尿病和高血压系统性疾病预测。在来自多国的标准化数据集上,对四种先进模型(RETFound、VisionFM、RetiZero、DINORET)进行评估,使用AUC和F1指标。结果表明,DINORET和RetiZero在眼病与系统病任务中表现最佳,其中RetiZero在外部数据集上泛化能力更强。基于门控的融合策略在青光眼、AMD和高血压预测中带来适度提升。尽管如此,外部队列中高血压预测仍具挑战。研究为眼科基础模型提供了实证评估,凸显融合优势,并指明提升临床应用的路径。
原文摘要 · Abstract (English)
Foundation models (FMs) have shown great promise in medical image analysis by improving generalization across diverse downstream tasks. In ophthalmology, several FMs have recently emerged, but there is still no clear answer to fundamental questions: Which FM performs the best? Are they equally good across different tasks? What if we combine all FMs together? To our knowledge, this is the first study to systematically evaluate both single and fused ophthalmic FMs. To address these questions, we propose FusionFM, a comprehensive evaluation suite, along with two fusion approaches to integrate different ophthalmic FMs. Our framework covers both ophthalmic disease detection (glaucoma, diabetic retinopathy, and age-related macular degeneration) and systemic disease prediction (diabetes and hypertension) based on retinal imaging. We benchmarked four state-of-the-art FMs (RETFound, VisionFM, RetiZero, and DINORET) using standardized datasets from multiple countries and evaluated their performance using AUC and F1 metrics. Our results show that DINORET and RetiZero achieve superior performance in both ophthalmic and systemic disease tasks, with RetiZero exhibiting stronger generalization on external datasets. Regarding fusion strategies, the Gating-based approach provides modest improvements in predicting glaucoma, AMD, and hypertension. Despite these advances, predicting systemic diseases, especially hypertension in external cohort remains challenging. These findings provide an evidence-based evaluation of ophthalmic FMs, highlight the benefits of model fusion, and point to strategies for enhancing their clinical applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。