提出可解释的多模态癌症生存预测框架,兼顾精度与可解释性。
Bridging the gap between Performance and Interpretability: An Explainable Disentangled Multimodal Framework for Cancer Survival Prediction
- 通过解耦建模病理图像与转录组数据,分离共享与特异性特征
- 在多个癌种中达到顶尖性能,且解耦程度优于现有方法
- 揭示乳腺癌中形态与通路关联,适合精准医疗研究者使用
尽管多模态生存预测模型的准确性不断提升,但其复杂性往往降低可解释性,难以揭示不同数据源对预测的影响。为此,我们提出DIMAFx,一种用于癌症生存预测的可解释多模态框架,能够从组织病理全切片图像和转录组数据中生成解耦的、可解释的模态特异与共享表征。在多个癌症队列中,DIMAFx 实现了最先进的性能并提升了表征解耦度。借助其可解释设计与SHAP分析,系统揭示了关键多模态交互及解耦表征中的生物信息。在乳腺癌生存预测中,最具预测性的特征包含共享信息,其中一项捕捉到以晚期雌激素反应为主导的实体瘤形态,高分级形态与通路上调及风险增加一致,符合已知乳腺癌生物学规律。关键模态特异性特征则反映来自脂肪与基质形态相互作用的微环境信号。结果表明,多模态模型可突破性能与可解释性之间的传统权衡,支持其在精准医学中的应用。
原文摘要 · Abstract (English)
While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an explainable multimodal framework for cancer survival prediction that produces disentangled, interpretable modality-specific and modality-shared representations from histopathology whole-slide images and transcriptomics data. Across multiple cancer cohorts, DIMAFx achieves state-of-the-art performance and improved representation disentanglement. Leveraging its interpretable design and SHapley Additive exPlanations, DIMAFx systematically reveals key multimodal interactions and the biological information encoded in the disentangled representations. In breast cancer survival prediction, the most predictive features contain modality-shared information, including one capturing solid tumor morphology contextualized primarily by late estrogen response, where higher-grade morphology aligned with pathway upregulation and increased risk, consistent with known breast cancer biology. Key modality-specific features capture microenvironmental signals from interacting adipose and stromal morphologies. These results show that multimodal models can overcome the traditional trade-off between performance and explainability, supporting their application in precision medicine.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。