对比模型与智能体级别的安全漏洞,发现智能体特有风险
Mind the Gap: Comparing Model- vs Agentic-Level Red Teaming with Action-Graph Observability on GPT-OSS-20B
- 用行动图可观测框架拆解智能体系统,分层进行红队测试
- 智能体场景下工具调用使漏洞率提升24%,存在仅在智能体中出现的漏洞
- 部分模型漏洞无法迁移至智能体环境,说明二者风险不互通
随着行业越来越多采用智能体式AI系统,理解其独特漏洞变得至关重要。以往研究认为模型层面的安全缺陷无法完全反映智能体部署中的风险,因为模型会与工具和外部环境交互。本文通过对比分析200亿参数开源模型GPT-OSS-20B在两种层级上的安全表现:独立模型与处于智能体循环中的模型。借助可观察性框架AgentSeer,我们将智能体系统分解为细粒度动作与组件,采用来自HarmBench的有害目标进行迭代红队攻击。评估结果揭示了模型级与智能体级漏洞特征的根本差异。关键发现包括:存在仅在智能体执行上下文中出现的‘智能体独有漏洞’;智能体级迭代攻击成功达成原本在模型级完全失败的目标,其中工具调用上下文的漏洞率比非工具上下文高出24%;而某些模型专属攻击仅在独立模型中有效,在智能体环境中失效,表明独立模型的漏洞并不总能泛化到实际部署系统。
原文摘要 · Abstract (English)
As the industry increasingly adopts agentic AI systems, understanding their unique vulnerabilities becomes critical. Prior research suggests that security flaws at the model level do not fully capture the risks present in agentic deployments, where models interact with tools and external environments. This paper investigates this gap by conducting a comparative red teaming analysis of GPT-OSS-20B, a 20-billion parameter open-source model. Using our observability framework AgentSeer to deconstruct agentic systems into granular actions and components, we apply iterative red teaming attacks with harmful objectives from HarmBench at two distinct levels: the standalone model and the model operating within an agentic loop. Our evaluation reveals fundamental differences between model level and agentic level vulnerability profiles. Critically, we discover the existence of agentic-only vulnerabilities, attack vectors that emerge exclusively within agentic execution contexts while remaining inert against standalone models. Agentic level iterative attacks successfully compromise objectives that completely failed at the model level, with tool-calling contexts showing 24\% higher vulnerability than non-tool contexts. Conversely, certain model-specific exploits work exclusively at the model level and fail when transferred to agentic contexts, demonstrating that standalone model vulnerabilities do not always generalize to deployed systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。