无需配对数据,用原型增强跨模态信息,实现更可靠的生存预测。
Prototype-Guided Cross-Modal Knowledge Enhancement for Adaptive Survival Prediction
- 构建各模态专属原型库,捕捉风险特征
- 通过原型迁移补全缺失模态,提升预测鲁棒性
- 适合临床中单模态数据场景,实用价值高
组织基因组多模态生存预测因优异性能和精准医疗潜力受到关注。然而临床实践中常仅能获取单模态数据,限制了先进多模态方法的应用。为此,本文提出原型引导的跨模态知识增强框架(ProSurv),摆脱对配对数据的依赖,实现稳健且自适应的生存预测。首先引入模态内更新机制,构建包含全训练集统计信息的模态专属原型库,保留跨时间区间的关键风险特征。随后,跨模态转换模块利用学习到的原型,增强多模态输入的知识表征,并生成缺失模态的特征,确保在多样化场景下的稳定预测。在四个公开数据集上的大量实验表明,ProSurv在使用单模态或多模态输入时均优于现有最先进方法;消融研究进一步验证其广泛适用性。本研究解决了计算病理学中的关键实际挑战,具有重要应用价值。
原文摘要 · Abstract (English)
Histo-genomic multimodal survival prediction has garnered growing attention for its remarkable model performance and potential contributions to precision medicine. However, a significant challenge in clinical practice arises when only unimodal data is available, limiting the usability of these advanced multimodal methods. To address this issue, this study proposes a prototype-guided cross-modal knowledge enhancement (ProSurv) framework, which eliminates the dependency on paired data and enables robust learning and adaptive survival prediction. Specifically, we first introduce an intra-modal updating mechanism to construct modality-specific prototype banks that encapsulate the statistics of the whole training set and preserve the modality-specific risk-relevant features/prototypes across intervals. Subsequently, the proposed cross-modal translation module utilizes the learned prototypes to enhance knowledge representation for multimodal inputs and generate features for missing modalities, ensuring robust and adaptive survival prediction across diverse scenarios. Extensive experiments on four public datasets demonstrate the superiority of ProSurv over state-of-the-art methods using either unimodal or multimodal input, and the ablation study underscores its feasibility for broad applicability. Overall, this study addresses a critical practical challenge in computational pathology, offering substantial significance and potential impact in the field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。