arXiv:2505.01109cs.CVcs.AI2025-05中稿 · publication in the…被引 8

自监督学习让简单实例型方法在病理图像分类中超越复杂模型。

Self-Supervision Enhances Instance-based Multiple Instance Learning Methods in Digital Pathology: A Benchmark Study

  • 用自监督预训练提取高质量特征,再结合简单实例分类器提升性能。
  • 在BRACS和Camelyon16数据集上达到新最优结果,参数量极少。
  • 方法更易解释,适合临床医生理解,推动可解释性研究方向。

多实例学习(MIL)已成为全切片图像(WSI)分类的最佳方案,将每张切片划分为多个补丁,构成一个带有全局标签的“包”。MIL主要分两类:基于实例的方法独立分类每个补丁后聚合得分;基于嵌入的方法先聚合补丁特征再分类。尽管基于实例的方法更具可解释性,过去因对特征提取器质量敏感,通常被基于嵌入的方法取代。但自监督学习(SSL)显著提升了特征质量。本研究在4个数据集上开展710次实验,对比10种MIL策略、6种自监督方法、4种骨干网络及4种病理适配技术,并首次引入4种未在病理领域使用过的实例型MIL方法。结果表明:在优质SSL特征提取器支持下,极简实例型MIL方法性能与复杂先进嵌入型方法相当或更优,在BRACS和Camelyon16上刷新最优记录。由于其天然可解释性,建议未来重点投入病理适配的自监督方法,而非复杂嵌入型结构。

原文摘要 · Abstract (English)

Multiple Instance Learning (MIL) has emerged as the best solution for Whole Slide Image (WSI) classification. It consists of dividing each slide into patches, which are treated as a bag of instances labeled with a global label. MIL includes two main approaches: instance-based and embedding-based. In the former, each patch is classified independently, and then the patch scores are aggregated to predict the bag label. In the latter, bag classification is performed after aggregating patch embeddings. Even if instance-based methods are naturally more interpretable, embedding-based MILs have usually been preferred in the past due to their robustness to poor feature extractors. However, recently, the quality of feature embeddings has drastically increased using self-supervised learning (SSL). Nevertheless, many authors continue to endorse the superiority of embedding-based MIL. To investigate this further, we conduct 710 experiments across 4 datasets, comparing 10 MIL strategies, 6 self-supervised methods with 4 backbones, 4 foundation models, and various pathology-adapted techniques. Furthermore, we introduce 4 instance-based MIL methods never used before in the pathology domain. Through these extensive experiments, we show that with a good SSL feature extractor, simple instance-based MILs, with very few parameters, obtain similar or better performance than complex, state-of-the-art (SOTA) embedding-based MIL methods, setting new SOTA results on the BRACS and Camelyon16 datasets. Since simple instance-based MIL methods are naturally more interpretable and explainable to clinicians, our results suggest that more effort should be put into well-adapted SSL methods for WSI rather than into complex embedding-based MIL methods.

病理图像自监督多实例学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。