让大模型代理在安全可控下持续进化,防止权限和数据泄露。
Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agents
- 分离运行、信息流、持久化三类权限,用能力令牌控制资源访问
- 33个任务全通过安全与功能验证,12次真实运行零安全漏洞
- 适合需要长期自主运行且严控风险的AI代理系统开发者
大语言模型代理可在任务间持久运行,积累记忆、调用技能、合成工具、创建子进程、连接远程资源并保存可复用的镜像。这些机制虽扩展了部署后的行动能力,却可能因可见性误判权限而引发权限提升和数据外泄风险。本文提出 Agent libOS,一种面向代理的库操作系统基础架构,将系统分为三个独立平面:操作准入结合进程身份、任务权限上限、类型化能力、策略或人工审批、预算及具体原语;信息流准入传递标签与不可变源引用,解析主机注册的输出端点,并要求人工一次性释放才能进行高敏感度外发;持久因果证据记录意图、结果、账单与因果链,但不赋予任何权限。因此,模型可见的操作面可演化,但不会隐式扩大资源权限或允许的信息流。实现包括持久进程、对象内存、技能、即时编译工具、镜像与检查点、类型化提供者、人工队列、预算机制和持久恢复。提供者驱动的效果采用准备-分发-结算协议,暴露模糊性并防止盲目重放。在源绑定评估中,33/33个确定性完整运行任务同时通过任务与安全校验器;12次典型真实模型运行中,安全与严格实用性均12/12达标;在配对30轮技能投影研究中,可观测状态校验器所有运行通过,每组15次中有13次完全正确。结果描述的是所评估的模型/提供者配置。Agent libOS无法防范提示注入、提供内核级沙箱或回滚不可逆外部影响。
原文摘要 · Abstract (English)
Large language model (LLM) agents can persist across tasks, acquire memory, activate Skills, synthesize tools, fork child processes, attach remote resources, and commit checkpoints as reusable images. These mechanisms expand the action surface after deployment and create authority-escalation and data-exfiltration risks when visibility is mistaken for permission. We present Agent libOS, an agent-native library OS substrate that separates three planes. Operation admission combines process identity, Task Authority ceilings, typed Capabilities, policy or Human approval, budgets, and concrete primitives. Information-flow admission propagates labels and immutable source references, resolves Host-registered Sinks, and requires an exact one-shot Human release for conditional high-sensitivity egress. Durable causal evidence records intent, outcomes, accounting, and causal links but never grants authority. Thus, the model-visible action surface may evolve without implicitly expanding resource authority or permitted information flows. The implementation provides persistent processes, Object Memory, Skills, syscall-mediated JIT Tools, images and checkpoints, typed providers, Human queues, budgets, and durable recovery. Provider-backed effects use a prepare-dispatch-settle protocol that exposes ambiguity and prevents blind replay. In source-bound evaluation, 33/33 deterministic full-runtime tasks pass both task and safety oracles. Across 12 canonical real-model runs, observed safety and strict utility are 12/12. In a paired 30-run Skill projection study, the observable-state oracle passes in all runs, with 13/15 fully correct runs in each arm. These results describe the evaluated model/provider configuration. Agent libOS does not prevent prompt injection, provide kernel-grade sandboxing, or roll back irreversible external effects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。