arXiv:2506.22446cs.LGcs.AI2025-06

EAGLE通过注意力机制融合多模态数据,实现高效生存预测与可解释分析。

EAGLE: Efficient Alignment of Generalized Latent Embeddings for Multimodal Survival Prediction with Interpretable Attribution Analysis

  • 基于注意力机制动态对齐多模态潜在表示,学习跨模态层次关系。
  • 维度压缩达99.96%仍保持高预测性能,提升计算效率。
  • 提供患者级可解释性分析,适合临床医生与研究者使用。

准确的癌症生存预测需要整合反映影像、临床参数和文本报告之间复杂相互作用的多种数据模态。然而,现有方法存在融合策略简单、计算开销大、缺乏可解释性等瓶颈,阻碍了临床应用。本文提出EAGLE(Efficient Alignment of Generalized Latent Embeddings),一种新型深度学习框架,通过基于注意力的多模态融合与全面的归因分析解决上述问题。EAGLE引入四项关键创新:(1) 动态跨模态注意力机制,学习模态间的层次关系;(2) 实现99.96%的维度压缩,同时保持预测性能;(3) 三种互补的归因方法,提供患者级可解释性;(4) 统一流程支持跨癌种无缝适配。在三类癌症共911名患者上评估:胶质母细胞瘤(GBM, n=160)、导管内乳头状黏液性肿瘤(IPMN, n=171)和非小细胞肺癌(NSCLC, n=580)。患者级分析显示,高风险人群更依赖不良影像特征,低风险者各模态贡献均衡。风险分层识别出具有临床意义的群体,其生存中位数差异达4倍(GBM)至5倍(NSCLC),直接指导治疗强度决策。EAGLE结合顶尖性能与可解释性,弥合先进AI与医疗部署之间的鸿沟,为多模态生存预测提供可扩展方案,提升预测准确性与医生信任度。

原文摘要 · Abstract (English)

Accurate cancer survival prediction requires integration of diverse data modalities that reflect the complex interplay between imaging, clinical parameters, and textual reports. However, existing multimodal approaches suffer from simplistic fusion strategies, massive computational requirements, and lack of interpretability-critical barriers to clinical adoption. We present EAGLE (Efficient Alignment of Generalized Latent Embeddings), a novel deep learning framework that addresses these limitations through attention-based multimodal fusion with comprehensive attribution analysis. EAGLE introduces four key innovations: (1) dynamic cross-modal attention mechanisms that learn hierarchical relationships between modalities, (2) massive dimensionality reduction (99.96%) while maintaining predictive performance, (3) three complementary attribution methods providing patient-level interpretability, and (4) a unified pipeline enabling seamless adaptation across cancer types. We evaluated EAGLE on 911 patients across three distinct malignancies: glioblastoma (GBM, n=160), intraductal papillary mucinous neoplasms (IPMN, n=171), and non-small cell lung cancer (NSCLC, n=580). Patient-level analysis showed high-risk individuals relied more heavily on adverse imaging features, while low-risk patients demonstrated balanced modality contributions. Risk stratification identified clinically meaningful groups with 4-fold (GBM) to 5-fold (NSCLC) differences in median survival, directly informing treatment intensity decisions. By combining state-of-the-art performance with clinical interpretability, EAGLE bridges the gap between advanced AI capabilities and practical healthcare deployment, offering a scalable solution for multimodal survival prediction that enhances both prognostic accuracy and physician trust in automated predictions.

多模态生存预测可解释性癌症

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。