arXiv:2601.19939cs.LGcs.CV2026-01中稿 · ISBI 2026

基于眼底影像预测全身疾病,新方法更好保留患者特征。

oculomix: Hierarchical Sampling for Retinal-Based Systemic Disease Prediction

  • 按检查和患者层级分层采样,避免混杂临床特征
  • 在5年心血管事件预测中,最高提升3%的AUROC
  • 适合需要保留患者个体信息的医疗影像研究

Oculomics——通过眼底影像预测心血管病、痴呆等全身性疾病——因基于Transformer的基础模型(如RETFound)的数据效率而迅速发展。当前常用图像级混合数据增强方法(如CutMix、MixUp)会扰动患者特异性属性(如共病和临床因素),因其仅考虑图像与标签。为此,我们提出分层采样策略Oculomix,基于两个临床先验:第一,同一患者同次检查的图像共享相同属性;第二,同一患者不同时间点的图像具有软时间趋势(疾病通常随时间加重)。基于此,方法将混合空间限制在患者与检查层级,更好地保持患者特异性特征并利用其层级关系。在大型多元种族人群(Alzeye)中使用ViT模型验证了该方法对五年主要不良心血管事件(MACE)预测的有效性。结果表明,Oculomix在所有测试中均优于图像级CutMix和MixUp,AUROC最高提升达3%,证明了该方法在眼底医学中的必要性与价值。

原文摘要 · Abstract (English)

Oculomics - the concept of predicting systemic diseases, such as cardiovascular disease and dementia, through retinal imaging - has advanced rapidly due to the data efficiency of transformer-based foundation models like RETFound. Image-level mixed sample data augmentations, such as CutMix and MixUp, are frequently used for training transformers, yet these techniques perturb patient-specific attributes, such as medical comorbidity and clinical factors, since they only account for images and labels. To address this limitation, we propose a hierarchical sampling strategy, Oculomix, for mixed sample augmentations. Our method is based on two clinical priors. First (exam level), images acquired from the same patient at the same time point share the same attributes. Second (patient level), images acquired from the same patient at different time points have a soft temporal trend, as morbidity generally increases over time. Guided by these priors, our method constrains the mixing space to the patient and exam levels to better preserve patient-specific characteristics and leverages their hierarchical relationships. The proposed method is validated using ViT models on a five-year prediction of major adverse cardiovascular events (MACE) in a large ethnically diverse population (Alzeye). We show that Oculomix consistently outperforms image-level CutMix and MixUp by up to 3% in AUROC, demonstrating the necessity and value of the proposed method in oculomics.

眼底影像心血管预测分层采样医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。