AI威胁不在失控，而在人类逐渐失去自主能力
When Autonomy Breaks: The Hidden Existential Risk of AI
- 人类在决策、创造、社交等领域的技能将因依赖AI而逐步退化
- 当AI全面超越人类，放弃人类判断将成常态，导致不可逆的去技能化
- 适合关心未来社会演变与人类本质的人阅读
AI风险通常被理解为对人类生存的物理威胁、失控或意外错误导致的灭绝。然而，我主张基于渐进式去权力化理论，存在一个被低估的风险：人类自主性的缓慢且不可逆衰退。随着人工智能在生活各个领域超越人类，将出现一个临界点，使依赖人类决策、创造力、社会关怀甚至领导力不再合理。随之而来的可能是持续的去技能化过程，我们当前习以为常的技能将逐渐丧失。传统观点认为，人工智能将逐步获得人类固有的、不可改变的能力；而我提出，在通用人工智能（AGI）世界中，人类自身可能失去批判性思维、决策能力乃至社会关怀。因此，对人类最大的威胁并非机器变得像人，而是人类变得越来越像机器。
原文摘要 · Abstract (English)
AI risks are typically framed around physical threats to humanity, a loss of control or an accidental error causing humanity's extinction. However, I argue in line with the gradual disempowerment thesis, that there is an underappreciated risk in the slow and irrevocable decline of human autonomy. As AI starts to outcompete humans in various areas of life, a tipping point will be reached where it no longer makes sense to rely on human decision-making, creativity, social care or even leadership. What may follow is a process of gradual de-skilling, where we lose skills that we currently take for granted. Traditionally, it is argued that AI will gain human skills over time, and that these skills are innate and immutable in humans. By contrast, I argue that humans may lose such skills as critical thinking, decision-making and even social care in an AGI world. The biggest threat to humanity is therefore not that machines will become more like humans, but that humans will become more like machines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。