arXiv:2606.30755cs.CRcs.AI2026-06被引 2

测试爪形智能体安全漏洞,发现70%攻击成功率,暴露系统级防护短板。

Understanding and Evaluating Claw-like Agent Security Through a Computer-Systems Lens

论文配图:Understanding and Evaluating Claw-like Agent Security Through a Computer-Systems Lens
图 1 · 摘自论文原文
  • 将智能体类比为计算机系统,构建四类攻击面的测评框架
  • 实测最高攻击成功率70%,恶意插件100%成功
  • 现有模型防御力不足,适合研究系统安全的学者参考

爪形AI代理(如OpenClaw)是持续运行的进程,持久访问凭证、文件、工具和外部服务,承担系统级职责——安装包、维护状态、调度子任务、管理输入输出,一旦出错后果远超普通代理。但现有基准仅关注模型响应与工具调用,忽视跨组件失效模式。本文采用计算机系统类比:将代理视为一个由网关运行时(类操作系统)、技能(类应用)和插件(类可加载扩展)构成的系统,各组件均缺乏历经数十年演进的安全保护机制。基于此,我们构建SafeClawArena,包含406个对抗性任务,覆盖四个攻击面(技能供应链完整性、持久状态利用、跨边界数据流、间接提示注入),在容器化真实代理平台副本中执行,使用标记凭证并借助自动化污点追踪评估九个输出通道。评测三个平台(OpenClaw、NemoClaw、SeClaw)和五个前沿大模型。最高攻击成功率达70%;恶意插件在所有情况下均成功,不受大模型影响。SeClaw将GPT-5.4的攻击成功率从70%降至22%,主要源于效用-安全权衡而非主动防御;Claude-Opus-4.6在各平台上均已接近22%的下限。结果揭示当前防御机制的不足,并指明未来加固方向。代码与数据:https://github.com/sunblaze-ucb/SafeClawArena。

原文摘要 · Abstract (English)

Claw-like AI agents (e.g., OpenClaw) are always-on processes with persistent access to credentials, files, tools, and external services. They take on system-level responsibilities -- installing packages, maintaining state, scheduling subtasks, and mediating I/O -- making security failures far more severe than in other agents. Yet existing benchmarks focus on model responses and tool calls, leaving cross-component failure modes largely unmeasured. We adopt a computer-system analogy: treating a Claw-like agent as an agentic computer system whose gateway runtime plays an OS-like mediation role, whose Skills resemble user-installed applications, and whose Plugins resemble loadable extensions with runtime privileges. Each component has a classical counterpart whose protection mechanisms -- refined over decades of cybersecurity research -- are absent on the agent side. From this perspective, we develop SafeClawArena, a benchmark of 406 adversarial tasks across four attack surfaces (Skill Supply-Chain Integrity, Persistent State Exploitation, Cross-Boundary Data Flow, and Indirect Prompt Injection), executed in containerized replicas of real agent platforms with canary-marked credentials and evaluated via automated taint tracking across nine output channels. We evaluate three platforms (OpenClaw, NemoClaw, SeClaw) and five frontier LLMs. The highest attack success rate reaches 70%; malicious Plugins succeed in 100% of cases regardless of the LLM. SeClaw cuts GPT-5.4's attack success rate from 70% to 22%, partly through utility-security tradeoffs rather than active defenses, while Claude-Opus-4.6 already sits near a 22% floor on every platform. These results expose the inadequacy of current defenses and suggest directions for future hardening. Code and data: https://github.com/sunblaze-ucb/SafeClawArena.

AI安全系统级防护攻击面分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。