构建放射科病灶搜索基准数据集,提升医学影像视觉分析的可解释性。
GazeSearch: Radiology Findings Search Benchmark
- 基于目标导向的视觉搜索思路,重构眼动数据为聚焦病灶的任务序列。
- 提出ChestSearch模型,在新基准GazeSearch上实现更高扫描路径预测准确率。
- 为医疗影像视觉搜索提供可复现评估标准,适合研究可解释性与人机对齐者。
医学眼动数据是理解放射科医生如何视觉解读医学影像的重要信息源。这类数据不仅能提升深度学习模型在X光图像分析中的准确性,还能增强其可解释性,提高决策透明度。然而,当前眼动数据分散、未经处理且含义模糊,难以提取有效洞见。为此,本文提出一种受目标存在视觉搜索任务启发的重构方法:特定病灶存在时,注视点被引导定位该病灶。通过对现有眼动数据集进行处理,我们构建了一个专注病灶搜索的规范化数据集GazeSearch,每个注视序列均对准定位某一特定发现。随后,提出专用于GazeSearch的扫描路径预测基线模型ChestSearch。最后,利用GazeSearch作为基准,评估当前最先进方法在医学影像视觉搜索中的表现,提供领域内全面的性能评估。代码已开源于 <https://github.com/UARK-AICV/GazeSearch>。
原文摘要 · Abstract (English)
Medical eye-tracking data is an important information source for understanding how radiologists visually interpret medical images. This information not only improves the accuracy of deep learning models for X-ray analysis but also their interpretability, enhancing transparency in decision-making. However, the current eye-tracking data is dispersed, unprocessed, and ambiguous, making it difficult to derive meaningful insights. Therefore, there is a need to create a new dataset with more focus and purposeful eyetracking data, improving its utility for diagnostic applications. In this work, we propose a refinement method inspired by the target-present visual search challenge: there is a specific finding and fixations are guided to locate it. After refining the existing eye-tracking datasets, we transform them into a curated visual search dataset, called GazeSearch, specifically for radiology findings, where each fixation sequence is purposefully aligned to the task of locating a particular finding. Subsequently, we introduce a scan path prediction baseline, called ChestSearch, specifically tailored to GazeSearch. Finally, we employ the newly introduced GazeSearch as a benchmark to evaluate the performance of current state-of-the-art methods, offering a comprehensive assessment for visual search in the medical imaging domain. Code is available at \url{https://github.com/UARK-AICV/GazeSearch}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。