arXiv:2508.02957eess.IVcs.CV2025-08中稿 · the MICCAI 2025 MI…被引 4

融合眼底图像与基因数据,提升老年黄斑变性预测精度

AMD-Mamba: A Phenotype-Aware Multi-Modal Framework for Robust AMD Prognosis

  • 引入临床分期作为先验知识,优化特征学习以捕捉疾病进展
  • 在AREDS数据集上,新生物标志物显著提升早期高风险患者识别率
  • 适合关注眼科疾病预测、多模态医学影像分析的研究者

年龄相关性黄斑变性(AMD)是导致不可逆视力丧失的主要原因,有效预后对及时干预至关重要。本文提出AMD-Mamba框架,整合彩色眼底图像、52个基因变异及3个社会人口学变量,构建新型生物标志物。该框架采用视觉马尔可夫模型(Vision Mamba),同时融合局部病灶(如玻璃膜疣)与远距离血管变化等全局信息,并通过多尺度融合策略,在45,818张眼底图像、52个遗传位点和3个社会人口变量的AREDS数据集上实现性能提升。核心创新在于基于临床严重程度评分的度量学习机制,使模型能更好对齐临床表型,增强对疾病进程的建模能力。实验表明,所提生物标志物为预测AMD进展最显著的指标之一,结合现有变量可显著提高早期高风险患者的检出率,推动更精准主动的AMD管理。

原文摘要 · Abstract (English)

Age-related macular degeneration (AMD) is a leading cause of irreversible vision loss, making effective prognosis crucial for timely intervention. In this work, we propose AMD-Mamba, a novel multi-modal framework for AMD prognosis, and further develop a new AMD biomarker. This framework integrates color fundus images with genetic variants and socio-demographic variables. At its core, AMD-Mamba introduces an innovative metric learning strategy that leverages AMD severity scale score as prior knowledge. This strategy allows the model to learn richer feature representations by aligning learned features with clinical phenotypes, thereby improving the capability of conventional prognosis methods in capturing disease progression patterns. In addition, unlike existing models that use traditional CNN backbones and focus primarily on local information, such as the presence of drusen, AMD-Mamba applies Vision Mamba and simultaneously fuses local and long-range global information, such as vascular changes. Furthermore, we enhance prediction performance through multi-scale fusion, combining image information with clinical variables at different resolutions. We evaluate AMD-Mamba on the AREDS dataset, which includes 45,818 color fundus photographs, 52 genetic variants, and 3 socio-demographic variables from 2,741 subjects. Our experimental results demonstrate that our proposed biomarker is one of the most significant biomarkers for the progression of AMD. Notably, combining this biomarker with other existing variables yields promising improvements in detecting high-risk AMD patients at early stages. These findings highlight the potential of our multi-modal framework to facilitate more precise and proactive management of AMD.

AMD预测多模态学习视觉马尔可夫

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。