把自主AI比作宠物,人当饲养员,重塑人机信任关系。
AI, Trust, and Teaming: The Humans-as-Handlers Approach for Autonomous and Opaque AI Systems
- 以人类与宠物的关系类比人机协作,提出'饲养员'角色替代'用户'。
- 强调人类对AI系统决策结果负有清晰可追溯的责任。
- 适合关注人机共治、伦理设计的研究者和政策制定者。
人工智能日益普及,高度自主的系统在医疗、作战等关键领域执行任务,带来重大伦理与法律挑战,亟需建立基于信任的人机团队。本文主张,在这些高影响力领域,应将自主且不透明的AI系统类比为狗等与人类关系密切的动物。在此框架下,人类使用者不应被视为系统的'用户'或'部署者',而应扮演'饲养员'角色。这一角色重构改变了人、AI系统及其相互关系的认知,并明确界定了人类对使用系统所导致结果的责任。尽管机器与动物间存在不相似之处,但其共同点足以支撑该类比作为起点。进一步探讨如何摒弃人与动物关系中不适合人机协作的部分。最后指出,未来人机协同的发展方向应是将这些系统视为真实合作者,共同追求复杂目标并完成复杂任务。
原文摘要 · Abstract (English)
Artificial intelligence (AI) is becoming ubiquitous, and across domains, increasingly autonomous systems are carrying out tasks which raise significant ethical and legal challenges which demonstrate a need for strong human-machine teams rooted in trust. In this article, I argue that within highly impactful areas (such as medicine or warfighting) there are grounds for us initially treating autonomous and opaque systems as relevantly analogous to dogs (or other animals with which we have close relationships). Under this analogy, humans making use of these systems are not to be viewed as "users" or "deployers" of these systems, but instead take the role of "handlers". This recasting of roles shifts the way we view humans, AI-enabled and autonomous systems, and the relations between them, and moreover clarifies the clear and traceable lines of responsibility humans have for the outcomes brought about when using these systems. In developing this point, I clarify that the machine-animal analogy does admit disanalogous elements, but that its touch-points ground it as a starting point. I then explore how we can divest the humans-as-handlers approach of those aspects of our relationships with animals which are unfitting for how we engage with and make use of autonomous and AI-enabled systems. I conclude by arguing that the trajectory of human-machine teamings for autonomous and AI-enabled systems should be a state where we authentically view these not as artifacts which we simply make use of, but as collaborators with which we pursue complex goals and carry out complex tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。