arXiv:2503.13862cs.CVcs.LG2025-03被引 2

用双曲空间建模病理与基因数据的层次结构,提升癌症生存预测准确率。

HySurvPred: Multimodal Hyperbolic Embedding with Angle-Aware Hierarchical Contrastive Learning and Uncertainty Constraints for Survival Prediction

  • 在双曲空间中融合病理图像与基因数据的层级特征
  • 保留生存时间的连续有序性,提升模型优化效果
  • 利用删失数据中的信息,适合医学生存分析场景

整合组织病理图像与基因组数据的多模态学习在癌症生存预测中潜力巨大。然而现有方法存在三大局限:1)依赖欧氏空间中的多模态映射与度量,难以捕捉病理(不同分辨率图像块间)和基因组数据(从基因到通路)的层次结构;2)将生存时间离散化为独立风险区间,忽略其连续性和序数性,导致优化效果不佳;3)将删失视为二值指示符,排除删失样本参与模型优化,未能充分利用其信息。为此,我们提出 HySurvPred 框架,包含三个核心模块:多模态双曲映射(MHM)、角度感知的排序对比损失(ARCL)和删失条件不确定性约束(CUC)。MHM 模块在双曲空间中探索各模态内的固有层次结构;为更好融合双曲空间中的多模态特征,引入基于排序的对比损失(ARCL),以保持生存时间的序数特性,并通过 CUC 模块充分挖掘删失数据信息。大量实验表明,该方法在五个基准数据集上均优于现有最先进方法。代码将公开。

原文摘要 · Abstract (English)

Multimodal learning that integrates histopathology images and genomic data holds great promise for cancer survival prediction. However, existing methods face key limitations: 1) They rely on multimodal mapping and metrics in Euclidean space, which cannot fully capture the hierarchical structures in histopathology (among patches from different resolutions) and genomics data (from genes to pathways). 2) They discretize survival time into independent risk intervals, which ignores its continuous and ordinal nature and fails to achieve effective optimization. 3) They treat censorship as a binary indicator, excluding censored samples from model optimization and not making full use of them. To address these challenges, we propose HySurvPred, a novel framework for survival prediction that integrates three key modules: Multimodal Hyperbolic Mapping (MHM), Angle-aware Ranking-based Contrastive Loss (ARCL) and Censor-Conditioned Uncertainty Constraint (CUC). Instead of relying on Euclidean space, we design the MHM module to explore the inherent hierarchical structures within each modality in hyperbolic space. To better integrate multimodal features in hyperbolic space, we introduce the ARCL module, which uses ranking-based contrastive learning to preserve the ordinal nature of survival time, along with the CUC module to fully explore the censored data. Extensive experiments demonstrate that our method outperforms state-of-the-art methods on five benchmark datasets. The source code is to be released.

生存预测双曲嵌入多模态学习医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。