警告发展完全自主的AI代理，风险随控制权增加而上升
Fully Autonomous AI Agents Should Not be Developed
- 划分AI代理等级，分析各层级伦理权衡
- 自主性越高，对人类安全的风险越大
- 适合关注AI伦理与安全的政策制定者
本文主张不应开发完全自主的AI代理。基于既有科学文献和当前产品营销，我们界定不同层级的AI代理，剖析各层级涉及的伦理价值，并记录潜在收益与风险之间的权衡。分析显示，系统自主性越高，对人的风险越大：用户让渡的控制权越多，对人类造成的风险就越高。尤其令人担忧的是安全风险，这些风险威胁人类生命并影响其他核心价值。
原文摘要 · Abstract (English)
This paper argues that fully autonomous AI agents should not be developed. In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels and detail the ethical values at play in each, documenting trade-offs in potential benefits and risks. Our analysis reveals that risks to people increase with the autonomy of a system: The more control a user cedes to an AI agent, the more risks to people arise. Particularly concerning are safety risks, which affect human life and impact further values.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。