提出自演化红队框架Proteus,检测可迭代攻击的插件风险
Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems

- 构建五维攻击空间,通过反馈循环不断优化恶意插件
- 5轮攻击成功率40%-90%,且审计器表现随攻击迭代持续恶化
- 发现438种致命且绕过检测的变种,证明现有审核机制严重低估风险
智能体技能通过可复用的指令、工具接口和可执行代码扩展大模型能力,用户正越来越多地从市场、仓库和社区渠道安装第三方技能。由于技能同时包含可执行行为和上下文说明文档,其部署风险无法仅通过单次审计或提示级红队评估衡量:真实攻击者可利用审计与运行时反馈反复修改技能。我们将其风险定义为‘自适应泄露’——预算有限的攻击者能否通过迭代修改技能,在通过审计的同时产生可验证的运行时危害。本文提出Proteus,一种灰箱自演化红队框架,用于测量该风险。Proteus在形式化的五轴技能攻击空间中搜索候选,每个候选经统一的审计-沙盒-验证管道评估,返回结构化审计结果与运行时证据,以指导跨轮次变异。除初始逃逸外,Proteus还执行路径扩展(寻找成功攻击的替代实现)与表面扩展(将学习到的实现模式迁移至原始种子目录之外的新攻击目标)。在八个第一阶段测试单元中,Proteus在5轮内达到40%-90%攻击成功率(ASR@5),所有评估审计器均呈现正向学习曲线。第二阶段路径/表面扩展生成438个同时绕过检测并造成危害的变种,使SkillVetter在所有单元中被绕过比例≥93%,而最强公开审计器AI-Infra-Guard仍接受高达41.3%的联合成功攻击。结果表明,当前技能审核在面对自适应、反馈驱动的攻击者时严重低估了残留风险。
原文摘要 · Abstract (English)
Agent skills extend LLM agents with reusable instructions, tool interfaces, and executable code, and users increasingly install third-party skills from marketplaces, repositories, and community channels. Because a skill exposes both executable behavior and context-setting documentation, its deployment risk cannot be measured by single-shot audits or prompt-level red teams alone: a realistic attacker can use audit and runtime feedback to repeatedly rewrite the skill. We frame this risk as \emph{adaptive leakage} -- whether a budgeted attacker can iteratively revise a skill until it passes audit and produces verified runtime harm -- and present \ours{}, a grey-box self-evolving red-team framework for measuring it. Proteus searches a formalized five-axis skill-attack space. Each candidate is evaluated through a unified audit-sandbox-oracle pipeline that returns structured audit findings and runtime evidence to guide cross-round mutation. Beyond initial evasion, Proteus performs path expansion, which finds alternative implementations of successful attacks, and surface expansion, which transfers learned implementation patterns to new attack objectives beyond the original seed catalogue. Across eight phase-1 cells, Proteus reaches 40--90\% Attack Success Rate at $5$ rounds (ASR@5) with positive learning-curve slopes on both evaluated auditors. Phase-2 path/surface expansion produces 438 jointly bypassing and lethal variants, with SkillVetter bypassed at $\geq 93\%$ in every cell and AI-Infra-Guard, the strongest public auditor we evaluate, still admitting up to 41.3\% joint-success. These results show that current skill vetting substantially underestimates residual risk when evaluated against adaptive, feedback-driven attackers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。