用脑部MRI知识提升眼底图高血压预测,无需配对数据。
Clinical Graph-Mediated Distillation for Unpaired MRI-to-CFI Hypertension Prediction
- 构建跨模态临床相似图,桥接无配对的脑部MRI与眼底图像数据。
- 在新数据集上,眼底图高血压预测准确率显著优于传统方法。
- 适合医学多模态融合、医疗数据稀缺场景的研究者参考。
视网膜眼底成像可实现低成本、可扩展的高血压(HTN)筛查,但相关视网膜征象细微,导致预测方差大。脑部MRI能提供更显著的血管和小血管疾病标志物,但成本高且极少与眼底图像同步采集,造成模态孤立的数据集。本文研究无配对的MRI-眼底图像场景,提出临床图中介蒸馏(CGMD)框架,无需配对数据即可将MRI中蕴含的高血压知识迁移到眼底模型。CGMD通过构建跨越两个队列的临床相似性kNN图,利用共享结构化生物标志物作为桥梁;先训练一个MRI教师模型,将其表征沿图传播,并为眼底患者推断出基于脑部信息的表征目标;再通过联合目标(包括高血压标注监督、目标蒸馏和关系蒸馏)训练眼底学生模型。在新收集的无配对MRI-眼底-生物标志物数据集上的实验表明,CGMD持续优于标准蒸馏和非图插值基线。消融实验验证了临床基础图连通性的关键作用。代码已开源。
原文摘要 · Abstract (English)
Retinal fundus imaging enables low-cost and scalable hypertension (HTN) screening, but HTN-related retinal cues are subtle, yielding high-variance predictions. Brain MRI provides stronger vascular and small-vessel-disease markers of HTN, yet it is expensive and rarely acquired alongside fundus images, resulting in modality-siloed datasets with disjoint MRI and fundus cohorts. We study this unpaired MRI-fundus regime and introduce Clinical Graph-Mediated Distillation (CGMD), a framework that transfers MRI-derived HTN knowledge to a fundus model without paired multimodal data. CGMD leverages shared structured biomarkers as a bridge by constructing a clinical similarity kNN graph spanning both cohorts. We train an MRI teacher, propagate its representations over the graph, and impute brain-informed representation targets for fundus patients. A fundus student is then trained with a joint objective combining HTN supervision, target distillation, and relational distillation. Experiments on our newly collected unpaired MRI-fundus-biomarker dataset show that CGMD consistently improves fundus-based HTN prediction over standard distillation and non-graph imputation baselines, with ablations confirming the importance of clinically grounded graph connectivity. Code is available at https://github.com/DillanImans/CGMD-unpaired-distillation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。