AI决策看似给人选择,实则削弱真正决策能力,需警惕这种虚假自主。
The Illusion of Opting in AI-Mediated Consequential Decisions

- 提出'选择幻觉'概念:表面有选择,实则能力被削弱
- 强调保护元能力——形成、质疑、修正目标与手段的根基
- 为弱势群体设计三原则:诚实、生态理性、补救被剥夺的选项
基于乌尔曼-马加利特的'选择'概念(转变性、不可逆性、被被排除选项所笼罩),本文揭示当前AI系统引发了一项深层伦理问题:选择幻觉——个体与群体面对看似有意义的重大决策时,其真正决策所需的能动性已被削弱。反对将AI仅视为既定目标的优化器,主张应评估其是否保护并培育对抗选择幻觉的元能力:一种社会与制度共同支撑的、可形成、质疑、修订并拥有手段与目标的能力。这一重构对弱势群体尤为紧迫,因其最难以承担选择幻觉带来的代价。我们提出三项规范性原则:存在性诚实(承认预测局限)、生态理性(将引导置于多元生活生态中)和反事实修复(当AI决策路径失败时,承认并弥补被剥夺的替代方案)。
原文摘要 · Abstract (English)
Drawing on Ullmann-Margalit's concept of opting (transformative, irrevocable, and shadowed by foreclosed alternatives), we show that current AI systems raise a profound ethical problem that existing AI ethics has not fully captured: the illusion of opting, in which persons and groups encounter the deceptive appearance of meaningful consequential choice while the agency needed to become genuinely capable of choosing is weakened. Against approaches that treat AI primarily as an optimizer of already given ends, we argue that AI systems should be evaluated by whether they protect and cultivate meta-capacity against the illusion of opting: the socially and institutionally scaffolded agentive capacity through which means and ends can be formed, contested, revised, and owned. This reframing is especially urgent for disadvantaged populations, who are least able to absorb the costs of the illusion of opting when AI-mediated pathways misdirect behavior and action. We propose three normative imperatives for AI-mediated consequential decisions: existential honesty, which acknowledges the limits of prediction; ecological rationality, which situates guidance within heterogeneous lived ecologies; and counterfactual reparation, which acknowledges and repairs foreclosed alternatives when AI-mediated decision-making pathways fail.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。