arXiv:2508.01668eess.IVcs.CV2025-08中稿 · Medical Image Anal…被引 4

预测病理医生看癌变切片时的注视位置和时间,助力新人训练。

Measuring and Predicting Where and When Pathologists Focus their Visual Attention while Grading Whole Slide Images of Cancer

  • 用视窗移动轨迹建模医生注视路径,提取关键注视点。
  • 两阶段模型预测注视路径,准确率高于随机基线。
  • 适合医学影像训练、智能辅助诊断系统研发者使用。

预测专家病理医生在阅读前列腺癌全切片图像(WSI)时的视觉注意力分布,有助于提升病理培训系统的智能化水平。研究基于43位病理医生在123张全切片图像上的操作数据,通过数字显微镜记录其视窗的x、y坐标及放大倍数(m)变化,构建注视轨迹(scanpath)。提出一种注视点提取算法,保留语义信息的同时简化轨迹。采用两阶段模型:第一阶段用Transformer预测多倍率下的静态注意力热图;第二阶段基于第一阶段特征,以自回归方式逐点预测注视路径,起始于切片中心。实验表明,该模型显著优于随机猜测和基线模型。由此开发的工具可帮助病理学实习生学习专家级注意力分配策略。

原文摘要 · Abstract (English)

The ability to predict the attention of expert pathologists could lead to decision support systems for better pathology training. We developed methods to predict the spatio-temporal (where and when) movements of pathologists' attention as they grade whole slide images (WSIs) of prostate cancer. We characterize a pathologist's attention trajectory by their x, y, and m (magnification) movements of a viewport as they navigate WSIs using a digital microscope. This information was obtained from 43 pathologists across 123 WSIs, and we consider the task of predicting the pathologist attention scanpaths constructed from the viewport centers. We introduce a fixation extraction algorithm that simplifies an attention trajectory by extracting fixations in the pathologist's viewing while preserving semantic information, and we use these pre-processed data to train and test a two-stage model to predict the dynamic (scanpath) allocation of attention during WSI reading via intermediate attention heatmap prediction. In the first stage, a transformer-based sub-network predicts the attention heatmaps (static attention) across different magnifications. In the second stage, we predict the attention scanpath by sequentially modeling the next fixation points in an autoregressive manner using a transformer-based approach, starting at the WSI center and leveraging multi-magnification feature representations from the first stage. Experimental results show that our scanpath prediction model outperforms chance and baseline models. Tools developed from this model could assist pathology trainees in learning to allocate their attention during WSI reading like an expert.

医学影像注意力预测深度学习病理诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。