arXiv:2512.18986cs.LGcs.AI2025-12被引 4

用可解释AI融合脑影像与基因数据,预测阿尔茨海默病进展

R-GenIMA: Integrating Neuroimaging and Genetics with Interpretable Multimodal AI for Alzheimer's Disease Progression

  • 将脑区分割为视觉令牌,基因信息转为结构化文本,实现跨模态注意力对齐
  • 在ADNI数据集上四分类准确率达领先水平,识别出各阶段关键脑区与基因
  • 揭示了APOE等已知风险基因与特定脑区的关联,适合临床早筛与精准治疗研究

阿尔茨海默病早期检测需整合宏观脑结构变化与微观遗传易感性,但现有多模态方法难以对齐异质信号。我们提出R-GenIMA,一种可解释的多模态大语言模型,结合新型区域级视觉变压器与基因提示机制,联合建模结构磁共振成像(sMRI)与单核苷酸多态性(SNPs)变异。通过将解剖分区的脑区表示为视觉令牌,基因谱型编码为结构化文本,该框架实现跨模态注意力,连接区域萎缩模式与潜在遗传因素。应用于ADNI队列,R-GenIMA在正常认知(NC)、主观记忆困扰(SMC)、轻度认知障碍(MCI)和阿尔茨海默病(AD)四类分类中达到当前最优性能。除预测准确性外,模型生成生物意义明确的解释:识别出疾病阶段特异的脑区与基因特征,以及贯穿疾病全程的脑区-基因关联模式。基于注意力的归因分析显示,相关基因显著富集于已知全基因组关联研究支持的阿尔茨海默病风险位点,包括APOE、BIN1、CLU和RBFOX1。阶段解析的神经解剖学特征揭示了跨阶段共有的脆弱枢纽,以及阶段特异性模式:主观衰退期涉及纹状体,前颞叶在前驱期活跃,疾病晚期呈现多模态网络的整合破坏。结果表明,可解释的多模态人工智能可融合影像与遗传信息,揭示机制性洞察,为临床可部署工具提供基础,支持更早的风险分层并指导精准治疗策略。

原文摘要 · Abstract (English)

Early detection of Alzheimer's disease (AD) requires models capable of integrating macro-scale neuroanatomical alterations with micro-scale genetic susceptibility, yet existing multimodal approaches struggle to align these heterogeneous signals. We introduce R-GenIMA, an interpretable multimodal large language model that couples a novel ROI-wise vision transformer with genetic prompting to jointly model structural MRI and single nucleotide polymorphisms (SNPs) variations. By representing each anatomically parcellated brain region as a visual token and encoding SNP profiles as structured text, the framework enables cross-modal attention that links regional atrophy patterns to underlying genetic factors. Applied to the ADNI cohort, R-GenIMA achieves state-of-the-art performance in four-way classification across normal cognition (NC), subjective memory concerns (SMC), mild cognitive impairment (MCI), and AD. Beyond predictive accuracy, the model yields biologically meaningful explanations by identifying stage-specific brain regions and gene signatures, as well as coherent ROI-Gene association patterns across the disease continuum. Attention-based attribution revealed genes consistently enriched for established GWAS-supported AD risk loci, including APOE, BIN1, CLU, and RBFOX1. Stage-resolved neuroanatomical signatures identified shared vulnerability hubs across disease stages alongside stage-specific patterns: striatal involvement in subjective decline, frontotemporal engagement during prodromal impairment, and consolidated multimodal network disruption in AD. These results demonstrate that interpretable multimodal AI can synthesize imaging and genetics to reveal mechanistic insights, providing a foundation for clinically deployable tools that enable earlier risk stratification and inform precision therapeutic strategies in Alzheimer's disease.

阿尔茨海默病多模态模型可解释AI基因影像融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。