arXiv:2607.26574cs.CRcs.AI2026-07

修复解码漏洞可同时提升安全与可用性,但关键步骤仍存在权衡。

Attack Ensembles Expose a Safety-Utility Trade-off in Black-Box Guard Defenses Against Encoded VLM Jailbreaks

  • 通过恢复图像内容并解码编码,让防护模型看到原本看不见的语义
  • 修复后防御在多数攻击下表现更好,且误拦正常请求减少
  • 安全与可用性的权衡集中于解码后的重新筛查步骤,不可回避

安全分类器(‘守护者’)是视觉语言模型的主要黑盒防御机制,但其仅判断输入表面形式而非语义:将有害请求以集合论、形式逻辑、古典语言、代码或图像内文本等形式编码后,可绕过本应拦截的防护。标准做法是在守护前加入预处理模块以恢复图像内容并解码。我们构建该模块,并在11种已发表编码攻击的集成测试中评估,只要任一攻击成功即判定为失效。该指标揭示了两种被混淆的机制。恢复守护者原本无法看见的视图,能同时提升安全性和可用性——阻断更多攻击,且在平衡类别的良性样本上误拦更少,因重述请求可标准化边界表述从而降低过度标记。然而系统并未真正更安全:面对可自由选择11种编码的攻击者,关闭一个通道只会转移成功位置,无一种集成对比经多重检验校正仍显著有效。真正降低集成攻击成功率的是对恢复后表面的再次筛查,而这一步骤承担了全部良性误拦成本。因此,安全-可用性权衡并非来自恢复本身,而是聚焦于单一环节。在整个守护者×目标×条件的全因子实验中,没有任何配置能在集成攻击成功率≤40%的同时,保持良性误拦率低于70%。通常报告的单个攻击平均值严重低估攻击者能力约四倍,导致此前沿易被忽视。跨防御家族组合是唯一能推动安全轴的杠杆,优于所有测量配置,但仍远超可部署的拒绝对话预算。

原文摘要 · Abstract (English)

Safety classifiers ("guards") are the dominant black-box defense for vision-language models, yet a guard judges an input's surface form, not its meaning: a harmful request re-encoded as set theory, formal logic, a classical language, code, or text rendered inside an image slips past a guard that would block it in plain language - the decode gap. The standard fix is a preprocessor that recovers image content and decodes the encoding before the guard. We build one and evaluate it against an ensemble of eleven published encoding attacks, counting a behavior as broken if any attack succeeds. That metric separates two mechanisms such defenses conflate. Restoring a view the guard never had improves it on both axes at once: it blocks far more attacks, and, measured on a category-balanced benign set, it blocks fewer benign requests, because restating a request normalizes the borderline phrasing a classifier over-flags. It still does not make the system safer: against an attacker free to choose among eleven encodings, closing one channel relocates the success rather than removing it, and no ensemble contrast survives multiple-comparison correction. What does lower ensemble attack success is re-screening the recovered pre-decode surface, and that step is where the entire benign cost falls. The safety-utility trade-off is therefore not a property of recovery; it is localized to one step. Across the full guard x target x condition factorial, no configuration reaches an ensemble attack-success rate at or below 40% while holding benign over-refusal under 70%. The per-attack averages usually reported understate the attacker roughly fourfold, which is why this frontier is easy to miss. Composing across defense families is the one lever that moved the safety axis, beating every configuration we measured, and still landing far outside any deployable refusal budget.

模型安全视觉语言对抗攻击防御机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。