arXiv:2608.03247cs.CVcs.CL2026-08中稿 · MICCAI 2026

用临床信息引导三模态生存预测,提升癌症预后准确性

CIGTSurv: Clinical Information Guided Tri-modal Survival Prediction with Local Prototype Association and Global Feature Alignment

论文配图:CIGTSurv: Clinical Information Guided Tri-modal Survival Prediction with Local Prototype Association and Global Feature Alignment
图 1 · 摘自论文原文
  • 用大模型将临床表数据转为高维嵌入,作为跨模态锚点
  • 通过局部原型关联与全局特征对齐,提升多模态一致性
  • 在五个TCGA癌种数据集上达到当前最优预测效果

多模态学习通过整合病理图像与基因组数据显著推进了生存预测。然而,尽管临床信息能反映患者整体健康状况,其离散、稀疏且低维的特性导致其仍被严重忽视。此外,各模态间的固有异质性也给跨模态交互建模带来挑战。本文提出CIGTSurv,一种基于临床信息引导的三模态生存预测框架。首先,设计通用文本模板并利用预训练基础模型将临床表格数据转换为高维标记嵌入;随后,以临床信息为锚点,引入双层级交互机制:1)基于交叉注意力的局部原型关联(LPA)模块,显式学习不同模态间的逐标记对应关系;2)基于最大均值差异(MMD)的全局特征对齐(GFA)损失,隐式增强跨模态分布一致性。在五个TCGA癌症队列上的大量实验表明,CIGTSurv实现当前最优(SOTA)的生存预测性能。源代码已公开于https://github.com/Daijing-ai/CIGT-Surv.git。

原文摘要 · Abstract (English)

Multimodal learning has significantly advanced survival prediction by integrating pathology images with genomic data. However, clinical information, despite its critical role in reflecting a patient' s overall health, remains underutilized due to its discrete, sparse, and low-dimensional nature. Furthermore, the inherent heterogeneity across these modalities pose significant challenges in modeling cross-modal interactions. In this paper, we propose CIGTSurv, a Clinical Information Guided Tri-modal framework for Survival prediction. Specifically, we first design a holistic text template and use pretrained foundation models to transform clinical tabular data into high-dimensional tokenized embeddings. Using clinical information as an anchor, we then introduce a dual-level interaction mechanism: 1) a local prototype association (LPA) module based on cross-attention to explicitly learn token-level correspondences between different modalities, and 2) a global feature alignment (GFA) loss based on Maximum Mean Discrepancy (MMD) to implicitly enhance cross-modal distribution consistency. Extensive experiments on five TCGA cancer cohorts demonstrate that CIGTSurv achieves state-of-the-art (SOTA) survival prediction performance. Our source code is publicly available at https://github.com/Daijing-ai/CIGT-Surv.git.

生存预测多模态学习临床信息TCGA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。