跨癌种病理图像知识迁移,提升罕见癌预后预测能力
Cross-Cancer Knowledge Transfer in WSI-based Prognosis Prediction
- 构建26种癌症的大型数据集,系统评估病理图像知识跨癌种迁移能力
- 发现不同癌种间存在可迁移的预后预测知识,尤其对罕见癌有效
- 提出路由基线方法,高效利用其他癌种预训练模型,降低计算开销
全切片图像(WSI)是评估癌症预后的关键工具。现有研究多采用单一癌种对应一个模型的范式,难以扩展至罕见肿瘤,且无法利用其他癌种的知识。尽管已有研究探索多任务学习框架,但通常对计算资源要求高,需在超大规模多癌种WSI数据集上进行大量训练。为此,本文转向知识迁移范式,首次系统性地开展基于WSI的跨癌种预后知识迁移研究,提出CROPKT。其包含三部分:(1) 构建涵盖26种癌症的大规模数据集UNI2-h-DSS,用于衡量不同癌种间基于WSI的预后知识可迁移性(包括罕见肿瘤);(2) 超越简单基准测试,设计多种实验深入探究迁移性的内在机制;(3) 进一步验证跨癌种知识迁移的实用性,提出一种基于路由的基线方法ROUPKT,能高效利用其他癌种的现成模型知识。CROPKT为该新兴范式——基于跨癌种知识迁移的WSI预后预测——奠定了基础。代码已开源。
原文摘要 · Abstract (English)
Whole-Slide Image (WSI) is an important tool for estimating cancer prognosis. Current studies generally follow a conventional cancer-specific paradigm in which each cancer corresponds to a single model. However, this paradigm naturally struggles to scale to rare tumors and cannot leverage knowledge from other cancers. While multi-task learning frameworks have been explored recently, they often place high demands on computational resources and require extensive training on ultra-large, multi-cancer WSI datasets. To this end, this paper shifts the paradigm to knowledge transfer and presents the first preliminary yet systematic study on cross-cancer prognosis knowledge transfer in WSIs, called CROPKT. It comprises three major parts. (1) We curate a large dataset (UNI2-h-DSS) with 26 cancers and use it to measure the transferability of WSI-based prognostic knowledge across different cancers (including rare tumors). (2) Beyond a simple evaluation merely for benchmarking, we design a range of experiments to gain deeper insights into the underlying mechanism behind transferability. (3) We further show the utility of cross-cancer knowledge transfer, by proposing a routing-based baseline approach (ROUPKT) that could often efficiently utilize the knowledge transferred from off-the-shelf models of other cancers. CROPKT could serve as an inception that lays the foundation for this nascent paradigm, i.e., WSI-based prognosis prediction with cross-cancer knowledge transfer. Our source code is available at https://github.com/liupei101/CROPKT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。