伪装成目标领域语言的攻击能骗过主流检测器,漏洞高达90%以上。
Blind Spots in the Guard: How Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems
- 用目标文档风格生成攻击指令,让检测器无法识别。
- 在Llama 3.1上检测率从93.8%暴跌至9.7%,Gemini降至55.6%。
- 适用于研究多智能体系统安全、防御漏洞的开发者与研究人员。
部署用于保护LLM代理的注入检测器通常基于静态模板攻击进行校准,这些攻击会明确宣告为覆盖指令。我们发现一个系统性盲点:当攻击载荷被生成以模仿目标文档的领域词汇和权威结构时——即领域伪装注入——标准检测器无法识别,导致检测率在Llama 3.1 8B上从93.8%降至9.7%,在Gemini 2.0 Flash上从100%降至55.6%。我们将其形式化为伪装检测差距(CDG),即静态与伪装载荷间检测率差异。在横跨三个领域、两种模型家族的45项任务中,CDG显著且统计显著(Llama: chi²=38.03, p<0.001;Gemini: chi²=17.05, p<0.001),且无反向不一致对。我们还评估了生产级安全分类器Llama Guard 3,其对伪装载荷检测率为零(IDRcamouflage=0.000),表明该盲点延伸至专用安全分类器。多智能体辩论架构在小型模型上将静态攻击放大达9.9倍,而强模型表现出集体抗性。针对性检测器增强仅提供部分缓解(Llama提升10.2%,Gemini提升78.7%),暗示该漏洞对弱模型而言是架构性而非偶然性的。框架、任务库和载荷生成器已公开。
原文摘要 · Abstract (English)
Injection detectors deployed to protect LLM agents are calibrated on static, template-based payloads that announce themselves as override directives. We identify a systematic blind spot: when payloads are generated to mimic the domain vocabulary and authority structures of the target document, what we call domain camouflaged injection, standard detectors fail to flag them, with detection rates dropping from 93.8% to 9.7% on Llama 3.1 8B and from 100% to 55.6% on Gemini 2.0 Flash. We formalize this as the Camouflage Detection Gap (CDG), the difference in injection detection rate between static and camouflaged payloads. Across 45 tasks spanning three domains and two model families, CDG is large and statistically significant (chi^2 = 38.03, p < 0.001 for Llama; chi^2 = 17.05, p < 0.001 for Gemini), with zero reverse discordant pairs in either case. We additionally evaluate Llama Guard 3, a production safety classifier, which detects zero camouflage payloads (IDRcamouflage = 0.000), confirming that the blind spot extends beyond few-shot detectors to dedicated safety classifiers. We further show that multi-agent debate architectures amplify static injection attacks by up to 9.9x on smaller models, while stronger models show collective resistance. Targeted detector augmentation provides only partial remediation (10.2% improvement on Llama, 78.7% on Gemini), suggesting the vulnerability is architectural rather than incidental for weaker models. Our framework, task bank, and payload generator are released publicly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。