用人类视觉机制设计模型,提升医学图像搜索准确率
Application of Ideal Observer for Thresholded Data in Search Task
- 基于人眼注意力机制,分两阶段筛选关键特征
- 阈值处理使模型在噪声环境下性能提升,尤其中间阈值最优
- 少样本训练仍贴近人眼表现,适合医疗等资源受限场景
本研究通过构建类人阈值化视觉搜索模型观察者,推进任务导向的图像质量评估。该理想观察者基于人类视觉系统,选择性处理高显著性特征,过滤无关变异,从而提升判别性能与计算效率。模型采用两阶段框架:候选区域筛选与决策判断。在候选筛选中使用阈值化数据精炼关注区域,各阶段特异性特征处理优化整体表现。模拟实验评估了阈值对特征图、候选定位及多特征场景的影响。结果表明,阈值化可排除低显著性特征,显著提升性能,尤其在噪声环境中;中间阈值常优于无阈值,说明保留相关特征比全量信息更有效。此外,模型仅需少量图像即可有效训练,且与人眼表现高度一致。研究显示,该新框架能准确预测临床真实任务中的人类视觉搜索表现,并为资源有限条件下的模型观察者训练提供解决方案。该方法亦适用于计算机视觉、机器学习、国防与安全图像分析等领域的人类视觉搜索建模。
原文摘要 · Abstract (English)
This study advances task-based image quality assessment by developing an anthropomorphic thresholded visual-search model observer. The model is an ideal observer for thresholded data inspired by the human visual system, allowing selective processing of high-salience features to improve discrimination performance. By filtering out irrelevant variability, the model enhances diagnostic accuracy and computational efficiency. The observer employs a two-stage framework: candidate selection and decision-making. Using thresholded data during candidate selection refines regions of interest, while stage-specific feature processing optimizes performance. Simulations were conducted to evaluate the effects of thresholding on feature maps, candidate localization, and multi-feature scenarios. Results demonstrate that thresholding improves observer performance by excluding low-salience features, particularly in noisy environments. Intermediate thresholds often outperform no thresholding, indicating that retaining only relevant features is more effective than keeping all features. Additionally, the model demonstrates effective training with fewer images while maintaining alignment with human performance. These findings suggest that the proposed novel framework can predict human visual search performance in clinically realistic tasks and provide solutions for model observer training with limited resources. Our novel approach has applications in other areas where human visual search and detection tasks are modeled such as in computer vision, machine learning, defense and security image analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。