MICE模型融合病理、临床与基因数据,提升癌症预后预测的泛化能力与数据效率。
A Multimodal Foundation Model to Enhance Generalizability and Data Efficiency for Pan-cancer Prognosis Prediction
- 采用功能各异的多专家架构,捕捉跨癌种与特定癌种特征。
- 在30种癌症中表现优于现有模型,内部/外部验证集C-index提升3.8%~11.2%与5.8%~8.8%。
- 适合需要高效利用少量数据进行精准预后的临床研究与个性化治疗场景。
多模态数据为全面理解肿瘤微环境提供了异质信息,但现有AI模型难以有效利用其丰富内容,且提取的表征泛化能力差。本文提出MICE(Multimodal data Integration via Collaborative Experts)——一种多模态基础模型,通过整合病理图像、临床报告和基因组数据,实现精准的泛癌预后预测。不同于传统多专家模块,MICE采用功能多样化的多个专家,全面捕获跨癌种与癌种特异性信息。基于涵盖30种癌症、共11,799名患者的多源数据,结合对比学习与监督学习增强模型泛化性。MICE在内部队列中C-index提升3.8%至11.2%,在独立队列中提升5.8%至8.8%,显著优于单模态及现有先进多专家模型。同时在多种临床场景下展现出优异的数据效率。该模型为泛癌预后预测提供了一种高效可扩展的基础框架,有望推动个性化治疗并改善临床结局。
原文摘要 · Abstract (English)
Multimodal data provides heterogeneous information for a holistic understanding of the tumor microenvironment. However, existing AI models often struggle to harness the rich information within multimodal data and extract poorly generalizable representations. Here we present MICE (Multimodal data Integration via Collaborative Experts), a multimodal foundation model that effectively integrates pathology images, clinical reports, and genomics data for precise pan-cancer prognosis prediction. Instead of conventional multi-expert modules, MICE employs multiple functionally diverse experts to comprehensively capture both cross-cancer and cancer-specific insights. Leveraging data from 11,799 patients across 30 cancer types, we enhanced MICE's generalizability by coupling contrastive and supervised learning. MICE outperformed both unimodal and state-of-the-art multi-expert-based multimodal models, demonstrating substantial improvements in C-index ranging from 3.8% to 11.2% on internal cohorts and 5.8% to 8.8% on independent cohorts, respectively. Moreover, it exhibited remarkable data efficiency across diverse clinical scenarios. With its enhanced generalizability and data efficiency, MICE establishes an effective and scalable foundation for pan-cancer prognosis prediction, holding strong potential to personalize tailored therapies and improve treatment outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。