用AI缩小人类可选动作范围,显著提升复杂决策效果。
Narrowing Action Choices with AI Improves Human Sequential Decisions
- AI预判并筛选动作集,人类从中选择以实现人机互补
- 实验显示人类表现比独立决策高30%,超越AI自身表现2%以上
- 适合需持续决策的场景,如应急响应、医疗诊断
近期研究发现,在分类任务中,可通过设计无需人类判断何时交出决策权的辅助系统,实现人机互补,使专家决策准确率高于单独使用专家或模型。本文将该原则扩展至序列决策任务:提出一种基于预训练AI代理的决策支持系统,通过缩小人类可选动作集,引导其从有限选项中决策。同时引入一种利用动作集平滑特性的老虎机算法,高效优化人类参与程度。在大规模人类实验(n=1600)中,参与者在野火防控游戏中使用本系统后表现优于独立决策者约30%,且超过所用AI代理2%以上,尽管该AI本身已显著优于无支持的参与者。相关数据与开源代码已公开于https://github.com/Networks-Learning/narrowing-action-choices。
原文摘要 · Abstract (English)
Recent work has shown that, in classification tasks, it is possible to design decision support systems that do not require human experts to understand when to cede agency to a classifier or when to exercise their own agency to achieve complementarity$\unicode{x2014}$experts using these systems make more accurate predictions than those made by the experts or the classifier alone. The key principle underpinning these systems reduces to adaptively controlling the level of human agency, by design. Can we use the same principle to achieve complementarity in sequential decision making tasks? In this paper, we answer this question affirmatively. We develop a decision support system that uses a pre-trained AI agent to narrow down the set of actions a human can take to a subset, and then asks the human to take an action from this action set. Along the way, we also introduce a bandit algorithm that leverages the smoothness properties of the action sets provided by our system to efficiently optimize the level of human agency. To evaluate our decision support system, we conduct a large-scale human subject study ($n = 1{,}600$) where participants play a wildfire mitigation game. We find that participants who play the game supported by our system outperform those who play on their own by $\sim$$30$% and the AI agent used by our system by $>$$2$%, even though the AI agent largely outperforms participants playing without support. We have made available the data gathered in our human subject study as well as an open source implementation of our system at https://github.com/Networks-Learning/narrowing-action-choices .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。