提出五级自主性框架，帮开发者设计人机协作的边界。
Levels of Autonomy for AI Agents
- 按用户角色划分五级自主性：操作员到观察者
- 每级明确用户控制方式与交互设计问题
- 可用来做AI自主性认证，适合系统设计者
自主性是AI代理的双刃剑，既带来变革性可能，也伴随严重风险。如何为代理设定合适的自主水平？我们主张，自主性应作为独立于能力与环境的设计决策。本文定义了五个逐步提升的自主级别，分别对应用户在交互中扮演的角色：操作员、合作者、顾问、审批者和观察者。每个级别描述了用户施加控制的方式，并提出设计人机交互的开放问题。我们进一步探讨该框架在单/多智能体系统中用于生成AI自主性证书的应用潜力。最后提出评估代理自主性的初步思路。本研究旨在推动真实世界中负责任且有用的AI代理部署。
原文摘要 · Abstract (English)
Autonomy is a double-edged sword for AI agents, simultaneously unlocking transformative possibilities and serious risks. How can agent developers calibrate the appropriate levels of autonomy at which their agents should operate? We argue that an agent's level of autonomy can be treated as a deliberate design decision, separate from its capability and operational environment. In this work, we define five levels of escalating agent autonomy, characterized by the roles a user can take when interacting with an agent: operator, collaborator, consultant, approver, and observer. Within each level, we describe the ways by which a user can exert control over the agent and open questions for how to design the nature of user-agent interaction. We then highlight a potential application of our framework towards AI autonomy certificates to govern agent behavior in single- and multi-agent systems. We conclude by proposing early ideas for evaluating agents' autonomy. Our work aims to contribute meaningful, practical steps towards responsibly deployed and useful AI agents in the real world.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。