arXiv:2605.30454cs.CRcs.AI2026-05

同一攻击代码在不同输入渠道表现差异巨大,说明漏洞是模型与接口的共同属性。

The Surface You Test Is Not the Surface That Breaks

论文配图:The Surface You Test Is Not the Surface That Breaks
图 1 · 摘自论文原文
  • 用相同攻击数据分别测试工具输出和工具描述两个入口
  • GPT-4.1在输出通道96%失败,在描述通道仅4%;相反地,Gemini-3-Flash则反之
  • 漏洞本质是模型与接口的组合特性,防御需分通道评估

工具增强型大语言模型易受提示注入攻击:第三方控制部分上下文时,可植入指令使模型误认为来自用户。当前评估仅报告单一通道(工具输出)的成功率,并视为模型整体脆弱性。但工具描述(模型每轮调用前读取)本身也是可被利用的注入面。我们保持攻击载荷字节完全一致,通过13个来自六个模型家族的LLM及四个任务套件,在两个表面上进行测试。相同字节在不同模型上成功率反转:GPT-4.1在工具输出上96%成功,工具描述仅4%;而Gemini-3-FLASH则为20%与98%。对6,830次尝试的方差分解显示,表面本身贡献0%变异,模型-表面交互占16.7%。脆弱性属于配对属性,而非通道属性。自适应攻击率(各通道最大值)平均比固定通道基线高出9.1个百分点。标准提示级防御仅将工具输出的攻击成功率降至10%-18%,却无法有效防护描述通道(仍高于54%)。攻击与防御评估必须按表面分别报告。

原文摘要 · Abstract (English)

Tool-augmented LLM agents are vulnerable to prompt injection: a third party who controls part of the agent's context can plant instructions that the agent then executes as if they came from the user. Current evaluations report a single attack success rate per model on one channel, the tool output and treat that number as the model's vulnerability. But tool descriptions, which the agent reads at every turn before any tool is called, are themselves an injection surface that the attacker can choose instead. We hold the injection payload byte-identical and deliver it through both surfaces across 13 LLMs from six families and four task suites. The same bytes invert in success rate across models: GPT-4.1 is 96 percent vulnerable on tool outputs but only 4 percent on tool descriptions, while GEMINI-3-FLASH shows the mirror pattern at 20 percent and 98 percent. A variance decomposition over 6,830 attempts attributes 0 percent of the variation in attack outcomes to the surface alone, while the model-surface interaction accounts for 16.7 percent. Vulnerability is a property of the pairing, not the channel. The Adaptive Attack Rate, defined as the per-cell maximum over surfaces, exceeds the strongest fixed-surface baseline by +9.1 percentage points on average. Standard prompt-level defenses inherit the same blindspot, reducing tool-output ASR to 10-18 percent while leaving the description channel above 54 percent. Both attack and defense evaluation must report per-surface vulnerability.

提示注入模型安全攻击评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。