基于百万患者数据的多模态模型,可追踪癌症进展并预测治疗效果。
A Multimodal Foundation Model for Longitudinal Patient Representation and Scalable Insight Generation in Oncology

- 构建多模态时间序列模型,融合临床、基因与病理图像数据。
- 在生存预测上AUC达0.774,治疗效果评估比基线提升三倍。
- 支持机制可解释性分析,适合临床研究与新药开发使用。
精准肿瘤学需要能捕捉癌症演进与治疗过程的纵向患者模型,并整合多模态观测数据。我们提出oFM,一个基于167万真实世界癌症患者队列的奠基模型,融合临床轨迹与DNA、RNA及H&E病理数据。患者层面划分用于训练、验证与测试,超一百万患者用于训练。oFM编码每日临床与分子事件,并结合病理图像,随时间整合生成患者状态嵌入。评估冻结的oFM嵌入与专家标注的临床及分子基线特征相比,在预后基准测试中,治疗反应、无进展生存与总生存的AUC分别提升至0.774(基线0.563)。在11个对比治疗队列中,oFM嵌入的联合处理效益归一化AUTOC提升三倍,9个队列中疗效排序更优,且两组治疗内部预后区分能力更强。我们还评估了一种机制发现框架,通过证据驱动的时间图将下游模型预测结果与临床及生物学机制关联,适用于临床与药物研发场景。
原文摘要 · Abstract (English)
Precision oncology necessitates a longitudinal model of patient state that captures cancer evolution and treatment over time, integrating multimodal observations. We introduce the oFM, a foundation model developed on a real-world oncology cohort of 1.67 million cancer patients that integrates clinical trajectories with DNA, RNA, and H&E pathology. Patient-level partitions were reserved for training, validation, and testing, with over one million patients used for training. The oFM encodes daily clinical and molecular episodes and, along with pathology images, integrates them over time to produce a patient state embedding. We evaluate frozen oFM embeddings against expert-curated clinical and molecular baseline features. In prognostic benchmarks, the oFM improved AUC for treatment response, progression-free survival, and overall survival (0.774 vs. 0.563 for overall survival). Across 11 comparative-treatment cohorts, the oFM embeddings achieved a three-fold higher pooled and scale-normalized treatment-benefit AUTOC than baseline features with improved benefit ranking in 9 of 11 cohorts, and provided stronger prognostic discrimination within both treatment arms. We also evaluated a mechanism discovery framework that interprets downstream models built on oFM embeddings by linking their predicted outcomes to clinically and biologically grounded mechanisms through an evidence-grounded temporal graph, enabling evaluation in clinical and drug-development applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。