用眼底照片生成个性化的3D眼球模型,助力近视精准管理
Fundus2Globe: Generative AI-Driven 3D Digital Twins for Personalized Myopia Management
- 结合3D眼模与扩散模型,从2D眼底图重建3D眼球结构
- 重建精度达亚毫米级,可模拟屈光变化对眼后段的影响
- 无需昂贵MRI,适合临床普及,尤其惠及资源不足地区
近视预计到2050年将影响全球50%人口,病理性近视患者的眼球形状异常与严重视力损害密切相关。现有基于眼球形状的生物标志物需依赖磁共振成像(MRI),但成本高且难在常规眼科诊所应用。本文提出Fundus2Globe,首个从普遍可用的2D彩色眼底照片(CFPs)和常规元数据(眼轴长度、屈光度)生成个性化3D眼球模型的AI框架,摆脱对MRI的依赖。通过融合3D可变形眼模(编码生物力学形状先验)与潜在扩散模型,该方法在重建眼后段解剖结构方面达到亚毫米级精度,高效且准确。Fundus2Globe首次量化了眼底图像中视网膜病变(如巩膜葡萄肿)与经MRI验证的3D形状异常之间的关联,使临床医生能够模拟屈光变化对眼后段的影响。外部验证显示其生成性能稳健,对代表性不足群体亦具公平性。该技术将2D眼底成像转化为个性化的眼部3D数字孪生,为人工智能驱动的精准眼科诊疗铺平道路。
原文摘要 · Abstract (English)
Myopia, projected to affect 50% population globally by 2050, is a leading cause of vision loss. Eyes with pathological myopia exhibit distinctive shape distributions, which are closely linked to the progression of vision-threatening complications. Recent understanding of eye-shape-based biomarkers requires magnetic resonance imaging (MRI), however, it is costly and unrealistic in routine ophthalmology clinics. We present Fundus2Globe, the first AI framework that synthesizes patient-specific 3D eye globes from ubiquitous 2D color fundus photographs (CFPs) and routine metadata (axial length, spherical equivalent), bypassing MRI dependency. By integrating a 3D morphable eye model (encoding biomechanical shape priors) with a latent diffusion model, our approach achieves submillimeter accuracy in reconstructing posterior ocular anatomy efficiently. Fundus2Globe uniquely quantifies how vision-threatening lesions (e.g., staphylomas) in CFPs correlate with MRI-validated 3D shape abnormalities, enabling clinicians to simulate posterior segment changes in response to refractive shifts. External validation demonstrates its robust generation performance, ensuring fairness across underrepresented groups. By transforming 2D fundus imaging into 3D digital replicas of ocular structures, Fundus2Globe is a gateway for precision ophthalmology, laying the foundation for AI-driven, personalized myopia management.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。