设计可区分的AI代理,让人类更愿意交托任务。
Designing Algorithmic Delegates: The Role of Indistinguishability in Human-AI Handoff
- 基于人类对相似任务的分类认知,设计最优协作型AI代理。
- 最优代理性能远超独立运行的算法,但求解本身计算困难。
- 适合人机协同系统设计者,尤其关注任务特征分解场景。
随着AI技术进步,人们越来越愿意将任务委托给AI代理。在许多情况下,人类决策者会根据具体决策问题的特征决定是否委托。由于人类通常无法全面了解所有相关因素,他们会通过观察特征对不可区分的任务实例进行归类。本文研究了在存在类别划分的前提下,如何设计最优算法代理。我们发现,最优代理作为协作伙伴的性能可远超独立运行的算法代理。该问题本质为组合优化,即使在简单场景下,最优设计与任务属性间关系也十分复杂。一般情况下,寻找最优代理是计算上困难的。然而,我们在若干广泛情形下(如最优动作可分解为人类可观测特征与算法输入函数)找到了高效求解方法。最后,通过模拟设计者随时间迭代优化代理的过程,发现虽不能总恢复最优代理,但最终代理表现通常良好。
原文摘要 · Abstract (English)
As AI technologies improve, people are increasingly willing to delegate tasks to AI agents. In many cases, the human decision-maker chooses whether to delegate to an AI agent based on properties of the specific instance of the decision-making problem they are facing. Since humans typically lack full awareness of all the factors relevant to this choice for a given decision-making instance, they perform a kind of categorization by treating indistinguishable instances -- those that have the same observable features -- as the same. In this paper, we define the problem of designing the optimal algorithmic delegate in the presence of categories. This is an important dimension in the design of algorithms to work with humans, since we show that the optimal delegate can be an arbitrarily better teammate than the optimal standalone algorithmic agent. The solution to this optimal delegation problem is not obvious: we discover that this problem is fundamentally combinatorial, and illustrate the complex relationship between the optimal design and the properties of the decision-making task even in simple settings. Indeed, we show that finding the optimal delegate is computationally hard in general. However, we are able to find efficient algorithms for producing the optimal delegate in several broad cases of the problem, including when the optimal action may be decomposed into functions of features observed by the human and the algorithm. Finally, we run computational experiments to simulate a designer updating an algorithmic delegate over time to be optimized for when it is actually adopted by users, and show that while this process does not recover the optimal delegate in general, the resulting delegate often performs quite well.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。