为物理世界智能体设计带权限控制的技能,防止恶意指令导致危险动作。
Auto-Policy, not Auto-Skill: Compiled Agent Skills for the Physical World

- 在技能文件中内置类型化权限层,由机器可验证证据决定是否执行动作
- 实测拒绝60次全部攻击变种,且不误拦正常请求,5倍扩展仍有效
- 适合高风险场景如机器人、自动化控制系统,防范恶意技能劫持
当前自演化技能系统(AutoSkills, Hermes Agent)虽提升效率,却忽视安全核心:技能描述行为方式,策略决定哪些行为可变为动作。现有格式仅用标记语言和脚本表达技能,策略仍依赖模型判断,生成更多技能反而扩大漏洞。已知两类攻击:恶意技能破坏云端软件,以及越狱大模型操控机器人造成物理伤害。二者交集——恶意代理技能引发物理危害——尚未被报告。我们提出「借权攻击」(Borrowed Authority):因技能格式无类型化权限校验,恶意或误用技能可直接触发执行。为此提出边缘防护方案Edge Skillguard,将权限检查嵌入技能本身,基于世界状态与传感器证据进行验证。在真实边缘控制平面测试中,对五类攻击变种成功拦截全部60次,不阻断合法请求,且在5倍规模及跨主机Tailscale网络下仍保持有效。结果表明,高风险技能应与可机器验证的调用策略一同打包,确保物理动作依赖确凿证据而非代理声称。
原文摘要 · Abstract (English)
Self-evolving Skill harnesses (AutoSkills, Hermes Agent) generate more advisory orchestration automatically; their reported gains are efficiency, not safety. This misses the actual gap: a Skill describes how an agent should behave; a Policy decides which behavior is allowed to become an action. Today's format covers the first with markdown and scripts; the second is left to the model. Generating more Skills scales the gap, not the safety, especially when a wrong invocation can unlock a door or move money. Two adjacent attacks are documented: malicious skills compromising cloud software, and jailbroken LLM-controlled robots causing physical harm. Their intersection, malicious agent skills causing physical harm, follows directly but has not been reported. We name this class Borrowed Authority: Skills format gives the receiving agent no typed way to reject an inter-agent permission claim, so a malicious or misused Skill can drive actuation by attaching one. We propose Edge Skillguard, a typed authority layer that lives inside the Skill artifact rather than between tools as workflow engines do, with guards over world state and sensor evidence. On a live edge control-plane testbed, the guards reject 60/60 borrowed-authority requests across five attack variants without blocking benign requests, and the result holds at 5x scale and across hosts over a Tailscale mesh. These results suggest that high-risk Skills should co-package typed invocation policy with procedural knowledge, so that physical actions depend on machine-checkable evidence rather than peer-agent claims.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。