arXiv:2511.02826cs.CV2025-11被引 3

PLUTO-4是超大规模病理图像基础模型,支持多尺度部署与前沿诊断性能。

PLUTO-4: Frontier Pathology Foundation Models

  • 基于55万张切片构建自监督预训练模型,采用FlexiViT与单尺度设计兼顾效率与能力。
  • 在皮肤病理诊断中提升11%准确率,多任务评估均达当前最佳水平。
  • 适合医学研究、临床辅助诊断及跨机构应用,兼顾实用与前沿性能。

基于大规模病理图像语料库训练的基础模型已在多种组织病理学任务中展现出强大迁移能力。在此基础上,我们推出下一代病理基础模型PLUTO-4,将病理通用变换器(PLUTO)扩展至前沿规模。PLUTO-4家族包含两种互补的视觉变换器架构:一个轻量高效的PLUTO-4S模型,采用FlexiViT结构与2D-RoPE嵌入,优化多尺度部署;一个前沿规模的PLUTO-4G模型,使用单一图像块大小进行训练,以最大化表征能力与稳定性。两者均在包含551,164张全切片图像(WSIs)、来自137,144名患者、覆盖超过50家机构、60余种疾病类型和100余种染色方法的大规模多中心数据集上,通过源自DINOv2的自监督目标进行预训练。在公开与内部基准上的综合评估表明,PLUTO-4在需要不同空间与生物学上下文的任务中表现卓越,包括切片分类、分割和整片诊断。PLUTO-4S提供高吞吐量且鲁棒的实用性能,而PLUTO-4G在多个病理基准上建立新纪录,尤其在皮肤病理诊断中实现11%的性能提升。这些多样化改进凸显了PLUTO-4作为转化研究与诊断应用核心模型的潜力。

原文摘要 · Abstract (English)

Foundation models trained on large-scale pathology image corpora have demonstrated strong transfer capabilities across diverse histopathology tasks. Building on this progress, we introduce PLUTO-4, our next generation of pathology foundation models that extend the Pathology-Universal Transformer (PLUTO) to frontier scale. We share two complementary Vision Transformer architectures in the PLUTO-4 family: a compact and efficient PLUTO-4S model optimized for multi-scale deployment using a FlexiViT setup with 2D-RoPE embeddings, and a frontier-scale PLUTO-4G model trained with a single patch size to maximize representation capacity and stability. Both models are pretrained using a self-supervised objective derived from DINOv2 on a large multi-institutional corpus containing 551,164 WSIs from 137,144 patients across over 50 institutions, spanning over 60 disease types and over 100 stains. Comprehensive evaluation across public and internal benchmarks demonstrates that PLUTO-4 achieves state-of-the-art performance on tasks requiring varying spatial and biological context, including tile classification, segmentation, and slide-level diagnosis. The compact PLUTO-4S provides high-throughput and robust performance for practical deployment, while PLUTO-4G establishes new performance frontiers across multiple pathology benchmarks, including an 11% improvement in dermatopathology diagnosis. These diverse improvements underscore PLUTO-4's potential to transform real-world applications as a backbone for translational research and diagnostic use cases.

病理模型基础模型自监督学习医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。