提出可监管的主动代理理论,让AI助手自主判断何时该行动且不越界。
When Intelligence Becomes Agency: A Theory of Governed, Proactive Agency for Symbiotic AI Systems
- 构建持续授权下的主动代理框架,结合感知、意图与情绪评估决策。
- 定义共生代理为可撤销授权下的委托行为,保持与主人状态的持续耦合。
- 提供评估标准与参考架构,适用于长期陪伴型智能助手开发。
持久性AI助手旨在延伸人类在动态数字与物理环境中的注意力、记忆与协调能力。真正有用不仅需响应指令,更应自主判断情境是否需行动、何时行动、以何种模式,以及选择执行、询问、监控、推迟或主动克制。本文称之为激活问题。现有研究虽涵盖承诺、评估、混合主动交互与委派等部分,但均未将情境化激活与持续授权及问责关联。本文提出一种概念与形式化框架,通过感知、意图、情感-动机评估、约束与反馈,组织跨时间行为。区分自主代理与委派代理,定义共生代理为在持续可撤销授权下,与主事者状态持续耦合、推断其状况、有限个性化的行为模式。核心贡献在于整合激活决策与授权感知、行为选择、权限控制、可追溯约束及受限适应,以行为事件为分析单元。通过代理分类法、评估框架、建议基准场景与参考架构,为判断协助是否必要、及时、授权且可问责提供依据,超越任务完成本身。旨在指导始终在线的个人助理与具身支持系统的研发,增强人类能力的同时保障主体权威与判断力。
原文摘要 · Abstract (English)
Persistent AI assistants are intended to extend human attention, memory, and coordination across changing digital and physical environments. To be truly useful they must do more than just act when asked. They must decide on their own whether a situation warrants behavior at all, when it does and in what mode, whether to act, ask, monitor, defer or deliberately refrain. We call this the activation problem. Research on commitment, appraisal, mixed-initiative interaction and delegation each illuminates part of it, but none ties situated activation to continuing authorization and accountability. This paper develops a conceptual and formal framework for governed proactive agency, organizing behavior across time through perception, intent, affective-conative appraisal, constraint, and feedback. It distinguishes autonomous and delegated agency and defines symbiotic agency as delegation under a standing, revocable mandate, with continuing coupling to the principal's situation, calibrated inference of their condition, and bounded personalization. The distinctive contribution is an integrated account linking activation decisions to authorized perception, behavior selection, authority containment, traceable restraint, and constrained adaptation, with behavioral episodes as the unit of analysis. Through an agency classification method, an evaluation framework, proposed benchmark scenarios, and a reference architecture, the account provides a basis for specifying and assessing whether assistance is warranted, timely, authorized, and answerable beyond task completion alone. It is intended to guide the development and evaluation of always-present personal assistants and embodied support systems that augment human capabilities while preserving the principal's authority and judgment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。