用AI做决策时,要评估它带来的实际改变,而非仅看结果好坏。
When is using AI the rational choice? The importance of counterfactuals in AI deployment decisions
- 把用了AI和不用AI的两种结果对比,来判断是否值得部署
- 很多情况下,对用户有益的AI对决策者反而有负收益
- 用户微小调整使用方式,可能大幅影响整体效果,适合决策者参考
AI部署决策常基于反事实比较:使用AI与不使用AI所作决策的差异。因使用AI导致的糟糕决策(反事实失误)可能给决策者带来巨大负面影响,而好的决策(反事实成功)带来的额外收益却有限。本文提出将反事实结果纳入预期效用评估框架,揭示:第一,在许多场景下,AI对受益人效用为正,但对利益相关方和决策者效用为强负;第二,当AI与用户判断高度互补时,往往导致利益相关方严重损失;第三,用户与AI交互的细微变化可能显著影响利益相关方的效用;第四,专家过度自信和事后偏差会夸大高成本反事实失误的感知频率。该评估方法旨在帮助开发者与决策者理解反事实的微妙但深远影响,确保有益的AI得以合理应用。
原文摘要 · Abstract (English)
Decisions to deploy AI capabilities are often driven by counterfactuals - a comparison of decisions made using AI to decisions that would have been made if the AI were not used. Counterfactual misses, which are poor decisions that are attributable to using AI, may have disproportionate disutility to AI deployment decision makers. Counterfactual hits, which are good decisions attributable to AI usage, may provide little benefit beyond the benefit of better decisions. This paper explores how to include counterfactual outcomes into usage decision expected utility assessments. Several properties emerge when counterfactuals are explicitly included. First, there are many contexts where the expected utility of AI usage is positive for intended beneficiaries and strongly negative for stakeholders and deployment decision makers. Second, high levels of complementarity, where differing AI and user assessments are merged beneficially, often leads to substantial disutility for stakeholders. Third, apparently small changes in how users interact with an AI capability can substantially impact stakeholder utility. Fourth, cognitive biases such as expert overconfidence and hindsight bias exacerbate the perceived frequency of costly counterfactual misses. The expected utility assessment approach presented here is intended to help AI developers and deployment decision makers to navigate the subtle but substantial impact of counterfactuals so as to better ensure that beneficial AI capabilities are used.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。