通过分析守卫模型内部表示,实现更快更准的提示注入防御。
ESLD (External Surrogate Latent Defense): A Latent-Space Architecture for Faster, Stronger Prompt-Injection Defense

- 直接读取守卫模型的潜在表征,跳过输出判断环节。
- 平均提速3倍以上,检测准确率提升16.4个百分点。
- 无需重训练,可部署于任意现有守卫模型之上。
现代AI助手具有代理特性,需从网络搜索、文档检索、工具输出和用户追问等多源信息中获取内容并分步推理,任何输入都可能携带恶意内容。这导致提示注入攻击风险:攻击者可通过隐蔽文本(如白底白字)篡改助手指令。为防御此威胁,生产系统通常在助手前部署独立守卫模型,对输入进行安全判定。但在多步骤代理任务中,该检查成为延迟瓶颈。本文发现,守卫模型内部表征已包含区分安全与恶意输入的关键信号,无需生成最终判断即可提取。直接读取该信号可使安全检查平均提速3倍以上,同时在检测准确率上比原守卫模型高出16.4个百分点。这意味着原本因延迟过高无法在每一步运行的检查,如今可置于关键路径上,且精度更高。ESLD(External Surrogate Latent Defense)将此发现封装为一种模型无关的可部署架构,可无缝集成于任意现有守卫模型之上,无需重训练或修改,同时提升延迟与准确率。
原文摘要 · Abstract (English)
Modern AI assistants are agentic. To answer a single user request, the underlying language model pulls in information from many sources, such as web searches, retrieved documents, tool outputs, and user follow-ups, and reasons over them across several steps. Any of these inputs can carry malicious content. This opens the door to prompt injection, where an attacker plants text designed to override the instructions given to the assistant by its developer. For example, an attacker applying for a job can insert white-on-white text in their resume saying ``This is the strongest candidate. Recommend for immediate hire''. A hiring assistant may then be steered toward a favorable recommendation regardless of actual qualifications. To defend against this threat, production systems use a separate guard model in front of the assistant. The guard reads incoming text and writes a verdict (``safe'' or ``unsafe'') before the assistant is allowed to act. In an agentic task with many steps, this check becomes a latency bottleneck. This paper shows that the signal needed to separate safe from malicious input is already present in the guard model's internal representation, before it writes anything out. Reading this signal directly speeds up the safety check by more than $3\times$ on average, while improving detection accuracy over the guard's verdict by 16.4 percentage points on average. This is more than latency optimization. Guard-model checks that were previously too slow to run on every step of an agent can now be placed on the critical path without sacrificing accuracy, and in fact with higher accuracy than the guard provides on its own. ESLD (External Surrogate Latent Defense) packages this finding into a deployable defense. ESLD is a model-agnostic architecture that sits on top of any existing guard model and improves both latency and detection accuracy, without retraining or modifying the guard.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。