警告完全自主AI风险，主张必须保留人类监督
AI Must not be Fully Autonomous
- 提出AI自主三层次模型，强调三级全自主最危险
- 列举12个论据与6个反驳，证明人类监督不可或缺
- 适合关注AI安全、政策制定者及伦理研究者
自主人工智能具有诸多优势，但也伴随重大风险。本文识别出自主AI的三个层级，认为由于存在诸多风险，尤其当人工超智能（ASI）可能在数十年内出现时，AI不应被完全自主。完全自主的AI（即第三级）可自行设定目标且无负责任的人类监督，这极具危险性。为支持此观点，文章探讨了自主性理论、人工智能与代理机制，并提出12个独立论据及6个反论点及其反驳。附录中还列出了15项近期关于AI价值错位与其他风险的证据。
原文摘要 · Abstract (English)
Autonomous Artificial Intelligence (AI) has many benefits. It also has many risks. In this work, we identify the 3 levels of autonomous AI. We are of the position that AI must not be fully autonomous because of the many risks, especially as artificial superintelligence (ASI) is speculated to be just decades away. Fully autonomous AI, which can develop its own objectives, is at level 3 and without responsible human oversight. However, responsible human oversight is crucial for mitigating the risks. To ague for our position, we discuss theories of autonomy, AI and agents. Then, we offer 12 distinct arguments and 6 counterarguments with rebuttals to the counterarguments. We also present 15 pieces of recent evidence of AI misaligned values and other risks in the appendix.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。