arXiv:2607.11698cs.CRcs.AI2026-07被引 3

用智能体自动发现生产级智能体漏洞,生成可复用的安全知识图谱。

Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming

论文配图:Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming
图 1 · 摘自论文原文
  • 构建可验证的漏洞发现循环,通过智能体研究另一智能体的攻击面。
  • 在三个场景中发现跨模型通用漏洞核心,冻结知识图谱性能提升14.2个百分点。
  • 生成可审计的漏洞图谱,适合安全团队用于漏洞审查与修复验证。

生产级大模型智能体如Claude Code和Codex处理不可信内容、文件、命令和工作区状态,导致安全缺陷可被直接利用。红队测试必须跟上模型与工具的演进。现有方法主要优化攻击成功率并保留基准、载荷或攻击程序等记录,但仅反映攻击成功结果,未揭示不安全行为背后的触发条件。本文提出AHA,一种基于智能体研究环境的自动化红队框架,用于发现另一智能体的可复用漏洞知识。AHA采用可验证的发现循环:提出漏洞假设,构造反例验证器,实例化有效攻击,在沙箱中执行,反思执行轨迹,并将确认发现转化为漏洞概念图(VCG)。每个概念连接攻击面与不安全轨迹,包含断言、启用条件、反例验证器、迁移预测及支持证据。在Claude Code和Codex上针对直接与间接攻击的三个场景测试表明,所发现的概念揭示了跨模型与智能体的可复用漏洞核心。冻结后的VCG无需再搜索,在相同单次攻击协议下比最强基线提升14.2个百分点,且能跨场景与攻击通道迁移。该图谱为生产安全团队提供可审计的漏洞资产,可用于漏洞检查、补丁验证与安全知识积累。代码已开源:https://github.com/henrymao2004/Auto-research-red-teaming-in-sleep。

原文摘要 · Abstract (English)

Production LLM agents such as Claude Code and Codex operate over untrusted content, files, commands, and workspace state, making safety failures directly actionable. Red-teaming must therefore keep pace with evolving models and tools. Existing approaches mainly optimize attack success and preserve artifacts such as benchmarks, payloads, or attack programs, which record where attacks succeed but not the enabling conditions behind unsafe agent behavior. We study automated red-teaming for production LLM agents using one agentic research environment to discover reusable vulnerability knowledge about another. We present AHA, a falsifiable discovery loop that proposes a vulnerability hypothesis, constructs a falsifier, instantiates a valid attack, executes it in a sandboxed harness, reflects on the trajectory, and promotes confirmed findings into a Vulnerability Concept Graph (VCG). Each concept links an attacker-facing surface to an unsafe trajectory through a claim, enabling condition, falsifier, transfer prediction, and supporting evidence. Across Claude Code and Codex on three scenarios covering direct and indirect attacks, the discovered concepts reveal a reusable vulnerability core across models and agents. A frozen VCG requires no further search and outperforms the strongest frozen discovery baseline by 14.2 percentage points under the same single-shot protocol, while transferring across scenarios and attack channels. The resulting VCG provides an auditable artifact for production safety teams to inspect vulnerabilities, validate patches, and accumulate reusable safety knowledge. Our code is available at https://github.com/henrymao2004/Auto-research-red-teaming-in-sleep.

智能体安全红队测试漏洞挖掘知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。