AI辅助正悄然消解人的自主权,需设计恢复机制。
The Silent Cost of Artificial Intelligence Assistance: A Theory of Autonomy Surrender, the Recovery Mechanism, and the Restoration of Human Agency
- 提出自主权渐失理论,源于认知资源耗尽
- 发现脱离自主的临界点及恢复难度
- 强调主动重建控制权,适合人机设计者
人工智能融入人类决策环境带来了此前未被充分理论化的代价:为获取信息与计算支持,人类正逐步丧失自主权。基于人类身份与自主性差距(HIAG)框架,本文构建了自主权丧失的可测量、累积性理论模型,包含三个相互作用机制:无声的AI辅助成本,即自主权在无意识中逐步转移;超越临界阈值后,重新获得自主功能将变得认知与心理上困难;以及恢复机制,确立了系统设计中主动重获控制的责任与伦理义务。论文指出,人类重返决策环并非被动选择,而需有意识地恢复认知资源。因此,AI系统设计必须包含结构化重入路径,即恢复机制,以保障人类主体性并合理分配责任。模型进一步预测一种终端状态——偏好反转:对AI的依赖不再被视为缺陷,反而成为偏好,使自主权恢复从设计问题演变为文化与政治议题。研究对AI系统设计、治理框架与人因研究具有启示。
原文摘要 · Abstract (English)
The integration of artificial intelligence into human decision-making environments has introduced a previously undertheorized cost: the gradual surrender of human autonomy in exchange for access to information and computational assistance. Building on the Human Identity and Autonomy Gap (HIAG) framework, this paper advances a theoretical model of autonomy surrender as a measurable, cumulative process driven by cognitive bandwidth depletion. The model proposes three interacting mechanisms: the silent cost of AI assistance, in which autonomy is transferred incrementally and without awareness; the surrender threshold, beyond which reclaiming autonomous function becomes cognitively and psychologically difficult; and the recovery mechanism, which establishes the design obligation and the ethical responsibility accompanying deliberate human re-assumption of control. The paper argues that human re-entry into the decision loop is not a passive option but an active cognitive event requiring intentional bandwidth restoration. The design of AI systems must incorporate structured re-entry pathways, here termed recovery mechanisms, that preserve human agency while appropriately distributing responsibility. The model further predicts a terminal state, here termed preference inversion, in which functional dependence on AI assistance is experienced not as a deficit but as a preference, transforming the restoration of autonomy from a design problem into a cultural and political one. Implications are drawn for AI system design, governance frameworks, and human factors research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。