arXiv:2608.22066cs.CVcs.AI2026-08

用轻量模型选关键切片,大幅降低病理图像分析的计算开销。

ADMIL: Attention-Distilled Multiple Instance Learning for Selective Foundation Model Inference in Pathology

论文配图:ADMIL: Attention-Distilled Multiple Instance Learning for Selective Foundation Model Inference in Pathology
图 1 · 摘自论文原文
  • 训练轻量网络从大模型注意力中学习切片重要性,只对关键区域编码。
  • 在3个数据集上仅用4~128个切片即达全模型性能,节省超98%计算量。
  • 适合临床部署,显著降低延迟和算力需求,兼顾准确与效率。

基于注意力的多实例学习(ABMIL)利用病理基础模型嵌入进行切片级任务,但需对每个前景切片执行大型图像编码器,而注意力分布通常集中在少数信息丰富区域。本文提出ADMIL(注意力蒸馏多实例学习),一种选择性计算框架:将ABMIL教师模型的注意力分布通过KL散度蒸馏至轻量级切片选择模型PriorNet(基于EfficientNet)。推理时,PriorNet对前景切片池打分并选取前K个切片,仅在该子集上调用昂贵的基础模型(Virchow2),再由选定切片的ABMIL学生模型预测切片标签。在BRACS、PANDA和CAMELYON16数据集上,ADMIL分别以K=4、8、128个切片达到全教师模型的基准性能,避免超过98%的基础模型切片嵌入与模型推理浮点运算量。随机采样与教师注意力理想控制实验表明,性能提升依赖于任务相关切片选择而非单纯减少切片数量。定量与定性分析显示,PriorNet能高保真恢复教师模型的切片排序,并聚焦于任务相关的形态学区域。结果表明,几乎可完全去除昂贵的切片编码而不损失切片级性能,为临床环境中低延迟、低成本部署提供了可行路径。

原文摘要 · Abstract (English)

Attention-based multiple instance learning (ABMIL) using pathology foundation model embeddings is effective for slide-level tasks, but exhaustive inference requires applying a large image encoder to every foreground tile despite the subsequent attention distribution often concentrating over a small subset of informative regions. We introduce ADMIL (Attention-Distilled Multiple Instance Learning), a selective-compute framework that distills an ABMIL teacher's attention into a lightweight tile-selection model, PriorNet. Using an EfficientNet architecture, PriorNet learns the teacher attention distribution from raw tile pixels with KL divergence; at inference, it scores the foreground pool, selects the top-K tiles, and invokes the expensive foundation model only on that subset before a selected-bag ABMIL student predicts the slide label. Across BRACS, PANDA, and CAMELYON16, ADMIL matches full-teacher headline performance at K=4, 8, and 128 tiles, respectively, avoiding >98% of foundation model (Virchow2) tile embeddings and model inference FLOPs. Random and teacher-attention oracle controls show that this result depends on task-relevant selection rather than tile-count reduction alone. Quantitative and qualitative analyses suggest that PriorNet recovers the teacher's tile ordering with high fidelity while focusing on task-relevant morphological regions. ADMIL shows that nearly all expensive tile encodings can be removed without sacrificing slide-level performance, providing a potential path for more efficient deployment in clinical settings where latency and compute costs are key considerations.

多实例学习病理分析模型压缩高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。