arXiv:2412.01215cs.LG2024-12被引 6

融合多模态数据与不确定性,提升生存分析预测准确性

EsurvFusion: An evidential multimodal survival fusion model based on Gaussian random fuzzy numbers

  • 用高斯随机模糊数建模单模态数据,量化预测不确定性
  • 通过可靠性折扣层抑制噪声模态干扰,提升模型鲁棒性
  • 首个同时考虑不确定性与模态可靠性的多模态生存分析模型

多模态生存分析旨在整合临床、影像、文本、基因组等异构数据以提升生存结局预测精度。然而,不同数据源在结构、分布和语境上差异大,且真实标签常因随访不全而被截断(不确定)。本文提出新型证据多模态生存融合模型EsurvFusion,通过证据决策融合层在决策层联合处理数据与模型不确定性,并引入模态级可靠性机制。首先,利用新提出的高斯随机模糊数对单模态数据建模,生成带有认知与偶然不确定性(aleatoric and epistemic uncertainties)的生存预测;其次,通过可靠性折扣层估计各模态可靠性,修正噪声模态带来的误导影响;最后,设计多模态证据融合层,结合经折扣后的预测结果,形成统一可解释的生存分析模型,并揭示各模态的贡献度。该工作首次将不确定性与可靠性共同纳入多模态生存分析框架。在四个多模态生存数据集上的实验表明,模型有效处理高异质性数据,在多个基准上达到新最优性能。

原文摘要 · Abstract (English)

Multimodal survival analysis aims to combine heterogeneous data sources (e.g., clinical, imaging, text, genomics) to improve the prediction quality of survival outcomes. However, this task is particularly challenging due to high heterogeneity and noise across data sources, which vary in structure, distribution, and context. Additionally, the ground truth is often censored (uncertain) due to incomplete follow-up data. In this paper, we propose a novel evidential multimodal survival fusion model, EsurvFusion, designed to combine multimodal data at the decision level through an evidence-based decision fusion layer that jointly addresses both data and model uncertainty while incorporating modality-level reliability. Specifically, EsurvFusion first models unimodal data with newly introduced Gaussian random fuzzy numbers, producing unimodal survival predictions along with corresponding aleatoric and epistemic uncertainties. It then estimates modality-level reliability through a reliability discounting layer to correct the misleading impact of noisy data modalities. Finally, a multimodal evidence-based fusion layer is introduced to combine the discounted predictions to form a unified, interpretable multimodal survival analysis model, revealing each modality's influence based on the learned reliability coefficients. This is the first work that studies multimodal survival analysis with both uncertainty and reliability. Extensive experiments on four multimodal survival datasets demonstrate the effectiveness of our model in handling high heterogeneity data, establishing new state-of-the-art on several benchmarks.

生存分析多模态融合不确定性建模可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。