PATHS通过分层筛选,高效分析病理切片。
PATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysis
- 分层递归筛选切片区域,只保留诊断相关部分。
- 仅处理少量关键区域,仍达领先性能。
- 适合需要高效与可解释性的病理分析场景。
全切片图像(WSI)的计算分析近年来取得显著进展,广泛应用于生存预测、癌症亚型分类等重要诊断与预后任务。现有先进模型将整张切片(最大可达150,000×150,000像素)视为大量图像块的集合,因尺寸巨大需采用计算成本低的特征聚合方法。然而,其中大量图像块为无信息内容(如仅含健康或脂肪组织),引入显著噪声与存储开销。本文提出病理分层选择转换器(PATHS),一种新型自顶向下的弱监督层次化表示学习方法,用于病理切片级任务。其灵感来自人类病理学家在不同放大倍数下逐层筛选关注区域的诊断方式,通过递归过滤各倍率下的图像块,保留与诊断相关的少量关键区域。该方法避免了全切片处理的复杂性,支持二次方自注意力机制,并提供简单可解释的区域重要性度量。我们在癌症基因组图谱(TCGA)五个数据集上应用PATHS,结果表明,在仅处理极小比例切片的情况下,其在切片级预测任务上表现优于先前方法。
原文摘要 · Abstract (English)
Computational analysis of whole slide images (WSIs) has seen significant research progress in recent years, with applications ranging across important diagnostic and prognostic tasks such as survival or cancer subtype prediction. Many state-of-the-art models process the entire slide - which may be as large as $150,000 \times 150,000$ pixels - as a bag of many patches, the size of which necessitates computationally cheap feature aggregation methods. However, a large proportion of these patches are uninformative, such as those containing only healthy or adipose tissue, adding significant noise and size to the bag. We propose Pathology Transformer with Hierarchical Selection (PATHS), a novel top-down method for hierarchical weakly supervised representation learning on slide-level tasks in computational pathology. PATHS is inspired by the cross-magnification manner in which a human pathologist examines a slide, recursively filtering patches at each magnification level to a small subset relevant to the diagnosis. Our method overcomes the complications of processing the entire slide, enabling quadratic self-attention and providing a simple interpretable measure of region importance. We apply PATHS to five datasets of The Cancer Genome Atlas (TCGA), and achieve superior performance on slide-level prediction tasks when compared to previous methods, despite processing only a small proportion of the slide.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。