arXiv:2507.05077eess.IVcs.AI2025-07NeurIPS被引 2

用智能采样只看10%-20%关键区域,大幅降低计算成本仍保持高诊断准确率。

Sequential Attention-based Sampling for Histopathological Analysis

  • 基于强化学习的注意力机制,逐次选择最可能含诊断信息的图像块
  • 仅分析10%-20%高分辨率切片,诊断准确率媲美全图分析方法
  • 适合处理海量病理图像中稀疏关键区域的自动化诊断任务

深度神经网络在自动化病理分析中的应用日益广泛。然而,全切片图像(WSI)通常达到千兆像素级别,以高分辨率完整分析在计算上不可行。诊断标签大多仅在整张切片层面可得,因为专家对图像局部(切片)进行标注既费时又昂贵。此外,具有诊断意义的区域通常仅占整个切片的一小部分,因此对全图以全分辨率分析效率低下。本文提出SASHA——一种用于病理分析的序列注意力采样方法,采用深度强化学习实现高效分析。首先,通过轻量级分层注意力多实例学习(MIL)模型学习有效特征;其次,智能地选取并聚焦于少量(10%-20%)高分辨率图像块,实现可靠诊断。实验表明,SASHA在计算和内存开销仅为全图分析方法的极小部分情况下,达到了与当前最佳方法相当的性能,显著优于其他稀疏采样方法。我们建议将SASHA作为处理包含稀疏信息特征的大规模医学图像自动诊断任务的智能采样模型。代码开源地址:https://github.com/coglabiisc/SASHA。

原文摘要 · Abstract (English)

Deep neural networks are increasingly applied in automated histopathology. Yet, whole-slide images (WSIs) are often acquired at gigapixel sizes, rendering them computationally infeasible to analyze entirely at high resolution. Diagnostic labels are largely available only at the slide-level, because expert annotation of images at a finer (patch) level is both laborious and expensive. Moreover, regions with diagnostic information typically occupy only a small fraction of the WSI, making it inefficient to examine the entire slide at full resolution. Here, we propose SASHA -- Sequential Attention-based Sampling for Histopathological Analysis -- a deep reinforcement learning approach for efficient analysis of histopathological images. First, SASHA learns informative features with a lightweight hierarchical, attention-based multiple instance learning (MIL) model. Second, SASHA samples intelligently and zooms selectively into a small fraction (10-20\%) of high-resolution patches to achieve reliable diagnoses. We show that SASHA matches state-of-the-art methods that analyze the WSI fully at high resolution, albeit at a fraction of their computational and memory costs. In addition, it significantly outperforms competing, sparse sampling methods. We propose SASHA as an intelligent sampling model for medical imaging challenges that involve automated diagnosis with exceptionally large images containing sparsely informative features. Model implementation is available at: https://github.com/coglabiisc/SASHA.

病理分析智能采样注意力机制医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。