通过分层蒸馏加速病理切片分类,精准筛除无关区域。
AHDMIL: Asymmetric Hierarchical Distillation Multi-Instance Learning for Fast and Accurate Whole-Slide Image Classification
- 两阶段训练:先用高分辨率图生成注意力评分,再用低分辨率图预筛相关区域。
- 在Camelyon16上准确率提升5.3%,推理速度加快1.2倍。
- 适合需要快速高精度病理图像分析的临床研究与自动化诊断场景。
尽管多实例学习(MIL)在病理图像分类中表现优异,但其因需处理每张吉字节级全切片图像(WSI)中的数千个图像块而导致推理成本高昂。为此,我们提出AHDMIL——一种非对称分层蒸馏多实例学习框架,通过两步训练过程消除无关图像块,实现快速准确分类。AHDMIL包含两个核心组件:运行于高分辨率WSI的动态多实例网络(DMIN),以及分析对应低分辨率图像的双分支轻量级实例预筛网络(DB-LIPN)。第一阶段采用自蒸馏(SD),DMIN在进行WSI分类的同时生成每个图像块的注意力得分,以识别无关块;第二阶段采用非对称蒸馏(AD),DB-LIPN学习预测低分辨率图像块的相关性。由DB-LIPN预测为相关的图像块,在空间上与高分辨率图像块对应,用于微调和高效推理DMIN。此外,我们设计了首个基于切比雪夫多项式的柯尔莫哥洛夫-阿诺德(CKA)分类器,通过可学习激活层提升分类性能。在四个公开数据集上的大量实验表明,AHDMIL在分类性能和推理速度上均持续优于先前最优方法。例如,在Camelyon16数据集上,准确率相对提升5.3%,推理速度提升1.2倍。所有数据集上,曲线下面积(AUC)、准确率、F1分数和布莱尔分数均取得一致提升,平均推理加速比达1.2至2.1倍。代码已开源。
原文摘要 · Abstract (English)
Although multi-instance learning (MIL) has succeeded in pathological image classification, it faces the challenge of high inference costs due to the need to process thousands of patches from each gigapixel whole slide image (WSI). To address this, we propose AHDMIL, an Asymmetric Hierarchical Distillation Multi-Instance Learning framework that enables fast and accurate classification by eliminating irrelevant patches through a two-step training process. AHDMIL comprises two key components: the Dynamic Multi-Instance Network (DMIN), which operates on high-resolution WSIs, and the Dual-Branch Lightweight Instance Pre-screening Network (DB-LIPN), which analyzes corresponding low-resolution counterparts. In the first step, self-distillation (SD), DMIN is trained for WSI classification while generating per-instance attention scores to identify irrelevant patches. These scores guide the second step, asymmetric distillation (AD), where DB-LIPN learns to predict the relevance of each low-resolution patch. The relevant patches predicted by DB-LIPN have spatial correspondence with patches in high-resolution WSIs, which are used for fine-tuning and efficient inference of DMIN. In addition, we design the first Chebyshev-polynomial-based Kolmogorov-Arnold (CKA) classifier in computational pathology, which improves classification performance through learnable activation layers. Extensive experiments on four public datasets demonstrate that AHDMIL consistently outperforms previous state-of-the-art methods in both classification performance and inference speed. For example, on the Camelyon16 dataset, it achieves a relative improvement of 5.3% in accuracy and accelerates inference by 1.2.times. Across all datasets, area under the curve (AUC), accuracy, f1 score, and brier score show consistent gains, with average inference speedups ranging from 1.2 to 2.1 times. The code is available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。