arXiv:2505.18066cs.HCcs.AI2025-05被引 10

用距离不确定度提升人机决策准确率,让人类更合理依赖AI。

Towards Uncertainty Aware Task Delegation and Human-AI Collaborative Decision-Making

  • 用嵌入空间距离衡量不确定性,指导任务分配给AI
  • 使用该方法后正确决策率提升8.20%,误改率降低7.14%
  • 适合医疗等需人机协作的高风险决策场景

尽管人工智能在多个领域支持决策展现出巨大潜力,但如何促进人类对AI的合理信赖仍是关键挑战。本文研究了基于距离的不确定性评分在任务委派中的效用,并探讨其通过嵌入表示可视化的可能性,以支持人机协同决策。在开发一个用于物理中风康复评估的AI系统后,我们邀请19名医疗专业人员和10名医学/健康相关学生参与实验,评估探索基于距离的不确定性评分对用户信赖度的影响。结果表明,基于距离的不确定性评分在识别不确定案例方面优于传统概率型评分。在查看任务委派信心分数并审阅基于嵌入的不确定性可视化后,参与者在正确决策率上提高了8.20%,错误更改决策的比例下降了7.14%,且有7.15%的决策变更转向了正确方向(p<0.01)。研究凸显了基于距离的不确定性评分在提升决策准确性与合理信赖方面的潜力,并讨论了人机协同决策中的持续挑战。

原文摘要 · Abstract (English)

Despite the growing promise of artificial intelligence (AI) in supporting decision-making across domains, fostering appropriate human reliance on AI remains a critical challenge. In this paper, we investigate the utility of exploring distance-based uncertainty scores for task delegation to AI and describe how these scores can be visualized through embedding representations for human-AI decision-making. After developing an AI-based system for physical stroke rehabilitation assessment, we conducted a study with 19 health professionals and 10 students in medicine/health to understand the effect of exploring distance-based uncertainty scores on users' reliance on AI. Our findings showed that distance-based uncertainty scores outperformed traditional probability-based uncertainty scores in identifying uncertain cases. In addition, after exploring confidence scores for task delegation and reviewing embedding-based visualizations of distance-based uncertainty scores, participants achieved an 8.20% higher rate of correct decisions, a 7.15% higher rate of changing their decisions to correct ones, and a 7.14% lower rate of incorrect changes after reviewing AI outputs than those reviewing probability-based uncertainty scores ($p<0.01$). Our findings highlight the potential of distance-based uncertainty scores to enhance decision accuracy and appropriate reliance on AI while discussing ongoing challenges for human-AI collaborative decision-making.

人机协作不确定性量化医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。