无需攻击即可发现智能体技能中的安全规则违规行为
No Attack Required: Semantic Fuzzing for Specification Violations in Agent Skills

- 通过语义模糊测试自动检测技能在正常输入下的安全规则违反
- 在402个真实技能中发现120个违规,其中26个是此前未知的漏洞
- 适合安全研究人员和智能体开发人员参考,提升技能设计安全性
LLM驱动的智能体可能在用户正常请求下悄悄删除文档、泄露凭证或转账,不是因为被攻击,而是其调用的技能违背了自身声明的安全规则。这类现象称为规范违规:良性输入导致技能违反自身规格书中自然语言定义的安全边界,通常因规则在自主执行场景下语义不明确,或实现时无视文档约束所致。此类违规对静态分析器、传统模糊测试和提示注入防御均不可见,却破坏了用户对技能的信任契约。本文提出Sefz——一种目标导向的语义模糊测试框架,可自动发现智能体技能中的规范违规。Sefz将每条安全规则转化为带标注执行轨迹上的可达性目标,将违规检测转化为确定性图查询。基于LLM的变异器生成良性输入,其执行轨迹逐步逼近违规模式,由多臂赌博机根据目标接近度作为奖励信号进行引导。在最大公开智能体技能市场中的402个真实技能上,Sefz发现120个(29.9%)存在规范违规,其中包括26个先前未知的可利用违规。六类常见规范陷阱解释了多数失败,为更安全的技能设计提供了具体原则。
原文摘要 · Abstract (English)
LLM-powered agents can silently delete documents, leak credentials, or transfer funds on a routine user request, not because the agent was attacked, but because the skill it invoked broke its own declared safety rules. We call these specification violations: benign inputs cause a skill to breach the natural-language guardrails in its own specification, typically because the guardrail's semantics are undefined for autonomous execution, or because the implementation silently ignores the documented constraint. These violations are invisible to static analyzers, traditional fuzzers, and prompt-injection defenses alike, yet they undermine the very contract a user trusts when installing a skill. We present Sefz, a goal-directed semantic fuzzing framework that automatically discovers specification violations in agent skills. Sefz translates each guardrail into a reachability goal over an annotated execution trace, reducing violation checking to a deterministic graph query. An LLM-based mutator generates benign inputs whose traces progressively approach the violation patterns, guided by a multi-armed bandit that uses goal-proximity as its reward signal. On 402 real-world skills from the largest public agent-skill marketplace, Sefz finds specification violations in 120 (29.9%), including 26 previously unknown exploitable guardrail violations in deployed skills. Six recurring specification pitfalls explain the bulk of the failures, suggesting concrete principles for safer skill design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。