AI决策助手的实用效果,取决于其可信度与人的一致性程度。
Human-Alignment Influences the Utility of AI-assisted Decision Making
- 通过人类实验测试AI可信度与人的信心匹配度的关系
- 匹配度越高,决策效果越好,提升显著(n=703)
- 对齐后置处理可增强一致性与实用性,适合人机协作研究者
在人工智能辅助决策中,模型预测应附带可信度值。然而,决策者常难以判断何时信任这些值。近期研究指出,理性决策者的效用受限于AI可信度与自身信心的一致性。本文通过大规模人类实验(n=703)验证该假设,参与者在在线纸牌游戏中接受具备可调节一致性的AI辅助。结果表明:一致性程度与决策效用正相关;对AI可信度进行后处理以实现与参与者自身信心的多校准,能同时提升一致性和效用。
原文摘要 · Abstract (English)
Whenever an AI model is used to predict a relevant (binary) outcome in AI-assisted decision making, it is widely agreed that, together with each prediction, the model should provide an AI confidence value. However, it has been unclear why decision makers have often difficulties to develop a good sense on when to trust a prediction using AI confidence values. Very recently, Corvelo Benz and Gomez Rodriguez have argued that, for rational decision makers, the utility of AI-assisted decision making is inherently bounded by the degree of alignment between the AI confidence values and the decision maker's confidence on their own predictions. In this work, we empirically investigate to what extent the degree of alignment actually influences the utility of AI-assisted decision making. To this end, we design and run a large-scale human subject study (n=703) where participants solve a simple decision making task - an online card game - assisted by an AI model with a steerable degree of alignment. Our results show a positive association between the degree of alignment and the utility of AI-assisted decision making. In addition, our results also show that post-processing the AI confidence values to achieve multicalibration with respect to the participants' confidence on their own predictions increases both the degree of alignment and the utility of AI-assisted decision making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。