arXiv:2502.02707cs.CV2025-02被引 2

通过自蒸馏和上下文编码提升病理切片的多实例学习性能

LadderMIL: Multiple Instance Learning with Coarse-to-Fine Self-Distillation

  • 采用粗到精自蒸馏获取实例级标签,实现自迭代监督
  • 在五个临床任务上平均提升AUC 8.1%、F1-score 11%、C-index 2.4%
  • 适合需要高精度病理图像分析的研究者和临床辅助诊断场景

全切片图像(WSI)分析中的多实例学习(MIL)通常仅提供袋级别标注,忽略实例级学习,难以融合实例与袋级信息。本文提出LadderMIL框架,从两个方面改进:(1)引入实例级监督;(2)在袋级别学习实例间上下文信息。首先,设计粗到精自蒸馏(CFSD)机制,利用袋级训练网络自适应生成实例级标签,实现自提升的实例级监督。其次,提出上下文编码生成器(CEG),捕捉袋内实例的上下文外观特征。理论与实证证明了CFSD的实例可学习性。在乳腺癌受体状态分类、多类亚型分类、肿瘤分类及预后预测等多个临床基准任务中验证,相比最佳基线,平均提升AUC 8.1%、F1-score 11%、C-index 2.4%。

原文摘要 · Abstract (English)

Multiple Instance Learning (MIL) for whole slide image (WSI) analysis in computational pathology often neglects instance-level learning as supervision is typically provided only at the bag level, hindering the integrated consideration of instance and bag-level information during the analysis. In this work, we present LadderMIL, a framework designed to improve MIL through two perspectives: (1) employing instance-level supervision and (2) learning inter-instance contextual information at bag level. Firstly, we propose a novel Coarse-to-Fine Self-Distillation (CFSD) paradigm that probes and distils a network trained with bag-level information to adaptively obtain instance-level labels which could effectively provide the instance-level supervision for the same network in a self-improving way. Secondly, to capture inter-instance contextual information in WSI, we propose a Contextual Encoding Generator (CEG), which encodes the contextual appearance of instances within a bag. We also theoretically and empirically prove the instance-level learnability of CFSD. Our LadderMIL is evaluated on multiple clinically relevant benchmarking tasks including breast cancer receptor status classification, multi-class subtype classification, tumour classification, and prognosis prediction. Average improvements of 8.1%, 11% and 2.4% in AUC, F1-score, and C-index, respectively, are demonstrated across the five benchmarks, compared to the best baseline.

多实例学习病理图像自蒸馏上下文建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。