轻量级病理模型,可高效分析整张病理切片并预测肿瘤微环境。
GigaPath-Flash and GigaTIME-Flash: Efficient Pathology Foundation Models for Whole-Slide and Tumor Microenvironment Analysis

- 用轻量级视觉模型和长序列编码器实现切片级分析
- 性能达原模型97%且计算量降低50倍
- 开源免费,适合临床研究与精准医疗应用
基础模型正推动计算病理学发展,有望通过大规模组织病理数据学习可迁移表征,变革癌症诊断、预后与治疗选择。当前病理基础模型多局限于图像块级别,受许可证限制且计算成本高,难以支持大规模切片级临床与科研应用。本文提出 GigaPath-Flash 与 GigaTIME-Flash,两个高效病理与空间蛋白组预测模型。前者结合2200万参数的ViT-S图像块编码器与2100万参数的LongNet切片编码器,均在真实世界病理数据上预训练;其轻量编码器由十亿参数的GigaPath(ViT-g)蒸馏而来,共享于两模型。相比原模型,性能保留97%的同时计算量降低50倍。后者在此基础上直接从常规H&E染色图像预测肿瘤免疫微环境,预测质量优于原始基于CNN的GigaTIME,速度提升6倍,显存减少8倍。二者连同GigaPath与GigaTIME组成开放权重、Apache-2.0许可的模型家族,全部基于大规模真实临床数据预训练。通过发布所有模型与权重,为计算病理、免疫肿瘤学与精准健康提供可访问的基础工具。
原文摘要 · Abstract (English)
Foundation models have emerged as a driving force in computational pathology, with the potential to transform cancer diagnosis, prognosis, and treatment selection by learning transferable representations from large-scale histopathology data. A growing landscape of pathology foundation models now spans diverse data sources, architectures, and downstream applications. However, most pretrained models operate only at the image-tile level, use restrictive licenses, and remain computationally expensive, limiting large-scale slide-level clinical and research use. Here, we introduce GigaPath-Flash and GigaTIME-Flash, efficient models for whole-slide pathology AI and spatial proteomics prediction. GigaPath-Flash combines a 22M-parameter ViT-S tile encoder with a 21M-parameter LongNet slide encoder, both pretrained on large-scale real-world histopathology data. Its compact tile encoder is distilled from the billion-parameter GigaPath (ViT-g) teacher and shared by both models. GigaPath-Flash retains 97% of GigaPath's average slide-level performance with 50x less compute. GigaTIME-Flash extends this backbone to predict the tumor immune microenvironment directly from routine H&E images. It surpasses the original CNN-based GigaTIME in prediction quality while running 6x faster and using 8x less GPU memory. Together with GigaPath and GigaTIME, these models form an open-weight, Apache-2.0-licensed family pretrained on large-scale real-world clinical data. By releasing all models and weights, we provide accessible building blocks for computational pathology, immuno-oncology, and precision health.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。