现有AI代理运行时存在严重安全漏洞,新方案可完全修复且即刻可用。
Architectural Obsolescence of Unhardened Agentic-AI Runtimes
- 通过七项核心架构改进,实现对四类安全失效的100%检测
- 实测显示旧系统检测召回率全为0,新系统达到完美准确率
- 适合关注AI安全与可信执行的开发者及平台方
AI代理运行时在代表大模型调用工具、发送消息和操控设备时,必须确保动作与审计记录一致。本文揭示当前最成熟的单用户代理网关OpenClaw无法检测四种关键安全失效(F1-F4):门禁绕过、审计伪造、静默主机故障、目标错误,其召回率在1600样本测试中全为0.000。而新提出的enclawed-oss——一个MIT许可的开源替代品,包含七项缺失的架构组件(如双向检查器、哈希链审计日志、双层出口防护等),在相同测试下达到精确率、召回率、准确率均为1.000。该差距源于结构性缺陷而非参数问题:仅扩展DLP正则表达式即可使新系统F3检测提升14.6%,但旧系统无处可落。测试涵盖真实Discord与Telegram渠道,验证了其对曾被标记为不安全插件的支持能力。作者主张未加固的代理运行时已成过时设计,新方案兼具安全性与功能兼容性,建议全面重构而非配置调整,并邀请评审者用此测试框架评估任何候选系统。
原文摘要 · Abstract (English)
An agentic-AI runtime issues tool calls, sends messages, and actuates devices on behalf of an LLM. Catching the four ways an action can diverge from its audit record -- F1 gate-bypass, F2 audit-forgery, silent host failure, F4 wrong-target, -- is a load-bearing safety property of any such runtime. We show that upstream OpenClaw, the most engineered single-user agentic-AI gateway in public release, catches none of them: recall is 0.000 on every cell of every confusion matrix, on a 1600-sample template baseline through OpenClaw's actual production command-line interface (CLI) and on a ten-LLM cross-model generalisation run. Detecting F1--F4 requires seven specific runtime structures absent from OpenClaw's source tree: a biconditional checker, a hash-chained audit log, an extension admission gate, a two-layer egress guard, a Bell-LaPadula classification policy, a module-signing trust root, and a bootstrap seal. enclawed-oss -- an MIT-licensed drop-in fork that ships all seven -- reaches $P = R = F_1 =$ accuracy $= 1.000$ on the same input. The gap is structural, not parametric: a six-line append-only widening of enclawed-oss's data-loss-prevention (DLP) regex catalog raises per-channel F3 detection by 14.6\% net at unchanged precision; the same edit on OpenClaw has nowhere to land. The harness deliberately exercises real Discord and Telegram channels -- plugin categories the first enclawed release deleted as unsafe -- to show F1--F4 detection extends to those previously-unsafe extensions. With architectural superiority for security and feature parity for extensions, we argue that unhardened agentic-AI runtimes are architecturally obsolete: a strictly better alternative exists, is adoptable today, and the gap requires re-architecture rather than configuration. We invite reviewers to apply the harness to any candidate runtime.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。