用双因素检索提升放射科人机决策准确率
2-Factor Retrieval for Improved Human-AI Decision Making in Radiology
- 提出2因子检索,结合界面设计与数据检索,不依赖复杂计算
- 放射科医生在低信心时使用该方法,诊断准确率显著提升
- 适合需要可验证AI解释的临床决策支持场景
医学AI中的人机协作需明确临床医生应如何权衡AI建议。现有系统或缺乏可解释性,或依赖梯度热图、Shapley值等难以验证的方法。本研究对比了传统可解释AI技术与新提出的‘2因子检索(2FR)’——一种结合界面设计与搜索检索的技术,直接返回相同标签的图像,无需处理。该方法形成双重保障:(a) AI需正确检索图像;(b) 医生须将检索结果与当前病灶关联。在胸部X光诊断测试中,2FR显著提升了医生准确率,尤其在放射科医生低信心时效果更明显。结果强调了不同人机协作模式对临床决策准确性的关键影响。
原文摘要 · Abstract (English)
Human-machine teaming in medical AI requires us to understand to what degree a trained clinician should weigh AI predictions. While previous work has shown the potential of AI assistance at improving clinical predictions, existing clinical decision support systems either provide no explainability of their predictions or use techniques like saliency and Shapley values, which do not allow for physician-based verification. To address this gap, this study compares previously used explainable AI techniques with a newly proposed technique termed '2-factor retrieval (2FR)', which is a combination of interface design and search retrieval that returns similarly labeled data without processing this data. This results in a 2-factor security blanket where: (a) correct images need to be retrieved by the AI; and (b) humans should associate the retrieved images with the current pathology under test. We find that when tested on chest X-ray diagnoses, 2FR leads to increases in clinician accuracy, with particular improvements when clinicians are radiologists and have low confidence in their decision. Our results highlight the importance of understanding how different modes of human-AI decision making may impact clinician accuracy in clinical decision support systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。