融合多模型病理图像特征,提升整体分析性能。
Fusion of Multi-scale Heterogeneous Pathology Foundation Models for Whole Slide Image Analysis
- 通过多视角聚类筛选关键病灶区域,确保训练样本代表性。
- 设计分簇重嵌入机制,实时捕捉局部特征。
- 采用协同蒸馏策略融合全局特征,适合多模型集成场景。
全切片图像(WSI)分析在计算病理学中日益重要。近期病理基础模型(FMs)已在从WSI中提取多层次特征方面展现显著优势。然而,由于训练数据私有性和网络结构差异,现有病理FMs存在显著异质性,导致下游任务中特征使用时性能波动。为有效利用多个模型的优势,本文提出一种新型多尺度异构病理基础模型融合框架FuseCPath,实现更优的集成性能。主要贡献包括:(i) 提出基于多视图聚类的判别性切片筛选方法,通过多个FMs的嵌入表示过滤冗余或噪声样本;(ii) 设计分簇级重嵌入策略,动态捕捉切片级局部特征;(iii) 提出协同蒸馏机制,挖掘切片级模型间的关联。大量实验表明,FuseCPath在多个数据集上的多项任务中均达到当前最优性能。
原文摘要 · Abstract (English)
Whole slide image (WSI) analysis has emerged as an increasingly essential technique in computational pathology. Recent advances in the pathology foundation models (FMs) have demonstrated significant advantages in deriving meaningful patch-level or slide-level multi-scale features from WSIs. However, current pathology FMs have exhibited substantial heterogeneity caused by diverse private training datasets and different network architectures. This heterogeneity introduces performance variability when we utilize the features from different FMs in the downstream tasks. To fully explore the advantages of multiple FMs effectively, in this work, we propose a novel framework for the fusion of multi-scale heterogeneous pathology FMs, called FuseCPath, yielding a model with a superior ensemble performance. The main contributions of our framework can be summarized as follows: (i) To guarantee the representativeness of the training patches, we propose a multi-view clustering-based method to filter out the discriminative patches via multiple FMs' embeddings. (ii) To effectively fuse the patch-level FMs, we devise a cluster-level re-embedding strategy to online capture patch-level local features. (iii) To effectively fuse the slide-level FMs, we devise a collaborative distillation strategy to explore the connections between slide-level FMs. Extensive experiments demonstrate that the proposed FuseCPath achieves state-of-the-art performance across multiple tasks on diverse datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。