一个统一模型同时分析多种癌症数据,提升预后预测准确率。
A Multi-Modal Deep Learning Framework for Pan-Cancer Prognosis
- 融合病理图像、基因表达和四种元数据,多模态建模患者信息。
- 在7个癌症数据集上超越现有方法,平均生存预测准确率提升5.2%。
- 适合需要跨癌种通用预后模型的研究者和临床医生使用。
预后预测对患者生存分析、治疗方案优化和资源分配至关重要。现有模型虽在特定数据集上表现良好,但仍存在两方面局限:仅利用单一模态数据(如病理全切片图像WSI或基因表达);采用单癌种单模型范式,导致泛化能力差。本文提出一种名为UMPSNet的深度学习模型,综合构建病理图像与基因表达的编码器,并将人口统计、癌症类型、治疗方案及诊断结果四类元数据嵌入文本模板,通过文本编码器提取特征。采用基于最优传输(OT)的注意力机制实现多模态特征对齐与融合,引入引导式软专家混合(GMoE)机制缓解多癌种数据分布差异问题。通过多模态数据联合训练,UMPSNet在7个癌症数据集上优于所有现有方法,平均生存预测准确性提升5.2%,验证了单模型跨癌种泛化的有效性。代码已开源:https://github.com/binging512/UMPSNet。
原文摘要 · Abstract (English)
Prognostic task is of great importance as it closely related to the survival analysis of patients, the optimization of treatment plans and the allocation of resources. The existing prognostic models have shown promising results on specific datasets, but there are limitations in two aspects. On the one hand, they merely explore certain types of modal data, such as patient histopathology WSI and gene expression analysis. On the other hand, they adopt the per-cancer-per-model paradigm, which means the trained models can only predict the prognostic effect of a single type of cancer, resulting in weak generalization ability. In this paper, a deep-learning based model, named UMPSNet, is proposed. Specifically, to comprehensively understand the condition of patients, in addition to constructing encoders for histopathology images and genomic expression profiles respectively, UMPSNet further integrates four types of important meta data (demographic information, cancer type information, treatment protocols, and diagnosis results) into text templates, and then introduces a text encoder to extract textual features. In addition, the optimal transport OT-based attention mechanism is utilized to align and fuse features of different modalities. Furthermore, a guided soft mixture of experts (GMoE) mechanism is introduced to effectively address the issue of distribution differences among multiple cancer datasets. By incorporating the multi-modality of patient data and joint training, UMPSNet outperforms all SOTA approaches, and moreover, it demonstrates the effectiveness and generalization ability of the proposed learning paradigm of a single model for multiple cancer types. The code of UMPSNet is available at https://github.com/binging512/UMPSNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。