多层防御效果不叠加,因各层失败存在关联,需实测验证。
Layered LLM Defenses as an Ensemble: Access Tiers, Inference Cost, and the Measured Failure Correlation Between Defense Layers

- 用访问层级和推理开销分类防御层,构建可量化评估框架
- 实测七层堆叠中15对防御层失败相关性达0.30~0.75,联合攻击成功率超预测值0.172
- 防御效果受架构制约,多样性无法保证整体表现,必须端到端测量
实践者通过堆叠防御来保护大语言模型,假设各层效果能累积。然而,这种堆叠作为集成模型,其效果仅在成员在不同输入上失败时才成立——这正是安全领域推荐但从未测量的条件。本文提出两个工具:敌手访问层级模型(AATM)按敌手权限分为A0至A4级;成本模型将防御分五类推理开销,其中两类需训练权重或读取激活,对应于不同权限级别。由此推导出堆叠行为:覆盖度在层级内饱和,成本随类别上升,误拒率以并集方式累积,残余攻击成功率仅在独立条件下呈乘积下降。实测显示,一个自适应敌手攻击七层堆叠时,15对防御层的失败相关性ϕ为0.30至0.75,联合残余攻击成功率最高超出乘积预测0.172。按行为难度分层后,大部分相关性消失,表明依赖主要源于共同因果,但该依赖仍存在于置换推理、多数投票标签及外部校准阈值下。同一堆叠拒绝80%良性提示,却与最强单层统计无异。相关性由共享模型架构导致,非采样随机性,因此扩大成员池也无法削弱。多样性虽可选层,但无法预知最终堆叠表现,必须端到端测量。
原文摘要 · Abstract (English)
Practitioners defend large language models (LLMs) by stacking defenses, assuming the layers compound. A stack is an ensemble, and ensembles compound only under a condition the LLM security literature recommends but never measures: the members must fail on different inputs. Two instruments make that measurable. The Adversary Access-Tier Model (AATM) grades an adversary by the access it holds, from system-only (A0) to influence over training data (A4). A cost model sorts defenses into five classes of inference-time overhead; because two classes require training weights or reading activations, they tier the defender as AATM tiers the adversary. From these we derive how a stack behaves, and the quantities a defender cares about diverge: coverage saturates within a tier, cost rises by class, false refusals accumulate as a union, and residual attack success falls multiplicatively only under independence. We measure that independence. Running one adaptive adversary against a seven-layer stack, failure correlation is positive in all fifteen measurable pairs ($ϕ$ from $0.30$ to $0.75$), and the joint residual exceeds the multiplicative prediction by up to $0.172$. Stratifying on behavior difficulty dissolves most of the association, so the dependence is predominantly common-cause, but it survives permutation inference, majority-vote grader labels, and externally calibrated thresholds. The same stack refuses four in five benign prompts while remaining statistically indistinguishable from its strongest single layer. The dependence is architectural rather than sampling-based: members correlate through the model they all wrap, so no wider member pool weakens it. Diversity therefore selects stack members but does not predict what an assembled stack delivers, which has to be measured end to end.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。