arXiv:2511.09853cs.LG2025-11AAAI被引 3

首个面向生存分析的多模态持续学习方法,解决遗忘与模态融合难题。

ConSurv: Multimodal Continual Learning for Survival Analysis

  • 分阶段专家混合架构捕捉跨模态共享与特有知识
  • 新基准测试下,生存预测性能显著优于现有方法
  • 适合需要动态更新的临床医疗系统开发者

癌症生存预测对临床实践至关重要,可指导死亡风险评估并影响治疗方案。然而,基于单一数据集训练的静态模型难以适应动态变化的临床环境和持续的数据流,限制了实际应用。虽然持续学习(CL)能动态学习新数据,但现有方法主要针对单模态输入,在生存预测中存在严重灾难性遗忘。现实中,多模态数据如全切片图像与基因组信息能提供互补信息,忽略模态间关联会降低性能。为解决灾难性遗忘与海量全切片图像与基因组间的复杂模态交互问题,我们提出ConSurv——首个用于生存分析的多模态持续学习(MMCL)方法。ConSurv包含两个核心组件:多阶段专家混合(MS-MoE)与特征约束重放(FCR)。MS-MoE在不同网络阶段捕获任务共享与特定知识,包括双模态编码器及模态融合模块,学习模态间关系;FCR通过限制各层级特征偏差(包括双模态编码器层与融合层表示),增强已学知识并缓解遗忘。此外,我们构建了新基准数据集多模态生存分析增量学习(MSAIL),涵盖四个数据集,用于在持续学习场景下全面评估。大量实验表明,ConSurv在多个指标上均优于对比方法。

原文摘要 · Abstract (English)

Survival prediction of cancers is crucial for clinical practice, as it informs mortality risks and influences treatment plans. However, a static model trained on a single dataset fails to adapt to the dynamically evolving clinical environment and continuous data streams, limiting its practical utility. While continual learning (CL) offers a solution to learn dynamically from new datasets, existing CL methods primarily focus on unimodal inputs and suffer from severe catastrophic forgetting in survival prediction. In real-world scenarios, multimodal inputs often provide comprehensive and complementary information, such as whole slide images and genomics; and neglecting inter-modal correlations negatively impacts the performance. To address the two challenges of catastrophic forgetting and complex inter-modal interactions between gigapixel whole slide images and genomics, we propose ConSurv, the first multimodal continual learning (MMCL) method for survival analysis. ConSurv incorporates two key components: Multi-staged Mixture of Experts (MS-MoE) and Feature Constrained Replay (FCR). MS-MoE captures both task-shared and task-specific knowledge at different learning stages of the network, including two modality encoders and the modality fusion component, learning inter-modal relationships. FCR further enhances learned knowledge and mitigates forgetting by restricting feature deviation of previous data at different levels, including encoder-level features of two modalities and the fusion-level representations. Additionally, we introduce a new benchmark integrating four datasets, Multimodal Survival Analysis Incremental Learning (MSAIL), for comprehensive evaluation in the CL setting. Extensive experiments demonstrate that ConSurv outperforms competing methods across multiple metrics.

生存分析持续学习多模态医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。