将多张病理切片联合建模,提升生存预测准确性
Look a Group at Once: Multi-Slide Modeling for Survival Prediction
- 以多切片为单位建模,模拟医生集体阅片思路
- 在5个TCGA数据集上显著超越现有方法
- 适合需要综合多切片信息的病理诊断场景
生存预测是病理学中的关键任务。临床实践中,病理科医生常同时分析多例样本,借助更广泛的癌症表型提升评估效果。尽管深度学习取得进展,当前方法通常将每张切片独立建模,难以有效捕捉可比且切片无关的病理特征。本文提出GroupMIL框架,受临床集体分析实践启发,将多张切片视为一个样本,按序组织切片内与切片间的图像块,以捕捉跨切片预后特征。我们还设计了GPAMamba模型,促进切片内与切片间特征交互,在切片级图中有效捕捉局部微环境特征,并在组框架下揭示扩展图像块序列中的关键预后模式。此外,构建双头预测器,为每位患者提供全面的生存风险与概率评估。大量实验证明,本模型在五个来自TCGA的数据集上显著优于当前最优方法。
原文摘要 · Abstract (English)
Survival prediction is a critical task in pathology. In clinical practice, pathologists often examine multiple cases, leveraging a broader spectrum of cancer phenotypes to enhance pathological assessment. Despite significant advancements in deep learning, current solutions typically model each slide as a sample, struggling to effectively capture comparable and slide-agnostic pathological features. In this paper, we introduce GroupMIL, a novel framework inspired by the clinical practice of collective analysis, which models multiple slides as a single sample and organizes groups of patches and slides sequentially to capture cross-slide prognostic features. We also present GPAMamba, a model designed to facilitate intra- and inter-slide feature interactions, effectively capturing local micro-environmental characteristics within slide-level graphs while uncovering essential prognostic patterns across an extended patch sequence within the group framework. Furthermore, we develop a dual-head predictor that delivers comprehensive survival risk and probability assessments for each patient. Extensive empirical evaluations demonstrate that our model significantly outperforms state-of-the-art approaches across five datasets from The Cancer Genome Atlas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。