arXiv:2508.21581cs.CV2025-08中稿 · the Multimodal Lea…

融合病理与CT影像,提升肾癌复发风险预测精度

Integrating Pathology and CT Imaging for Personalized Recurrence Risk Prediction in Renal Cancer

  • 采用预训练模型+生存分析框架,分阶段融合影像与病理数据
  • 中间融合策略使模型表现接近优化后的临床评分标准
  • 适合肿瘤精准诊疗与医学AI研究者参考

透明细胞肾细胞癌(ccRCC)的复发风险评估对术后监测和治疗至关重要。目前广泛使用的Leibovich评分在个体化风险判断上能力有限,且未包含影像信息。本研究通过整合术前CT与术后病理全切片图像(WSIs),构建多模态复发预测模型。采用模块化深度学习框架,结合预训练编码器与基于Cox的生存建模,在单模态、晚期融合与中间融合三种设置下进行测试。在真实世界ccRCC队列中,基于病理的模型始终优于仅用CT的模型,表明病理具有更强预后价值。中间融合进一步提升性能,最佳模型(TITAN-CONCH with ResNet-18)接近调整后的Leibovich评分。随机打平策略缩小了临床基线与学习模型间的差距,提示离散化可能夸大个体化表现。简单嵌入拼接下,放射科信息主要通过融合发挥作用。结果证实了基于基础模型的多模态整合在个性化ccRCC风险预测中的可行性。未来应探索更优融合方式、更大规模多模态数据集及通用性CT编码器,以更好匹配病理建模能力。

原文摘要 · Abstract (English)

Recurrence risk estimation in clear cell renal cell carcinoma (ccRCC) is essential for guiding postoperative surveillance and treatment. The Leibovich score remains widely used for stratifying distant recurrence risk but offers limited patient-level resolution and excludes imaging information. This study evaluates multimodal recurrence prediction by integrating preoperative computed tomography (CT) and postoperative histopathology whole-slide images (WSIs). A modular deep learning framework with pretrained encoders and Cox-based survival modeling was tested across unimodal, late fusion, and intermediate fusion setups. In a real-world ccRCC cohort, WSI-based models consistently outperformed CT-only models, underscoring the prognostic strength of pathology. Intermediate fusion further improved performance, with the best model (TITAN-CONCH with ResNet-18) approaching the adjusted Leibovich score. Random tie-breaking narrowed the gap between the clinical baseline and learned models, suggesting discretization may overstate individualized performance. Using simple embedding concatenation, radiology added value primarily through fusion. These findings demonstrate the feasibility of foundation model-based multimodal integration for personalized ccRCC risk prediction. Future work should explore more expressive fusion strategies, larger multimodal datasets, and general-purpose CT encoders to better match pathology modeling capacity.

肾癌多模态生存分析病理影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。