用翻译攻击暴露大模型安全机制在多语言下的漏洞
Safety Targeted Embedding Exploit via Refinement

- 通过梯度引导翻译关键词,生成能绕过拒绝机制的多语言提示
- 在6个80亿参数模型上攻击成功率最高达96.7%,且可迁移至GPT-4o-mini
- 揭示英语主导的安全训练无法覆盖低资源语言,适合关注多语言安全的研究者
大型语言模型(LLMs)的安全训练主要基于英语,导致其在低资源语言和混合语言代码切换场景下的泛化能力存疑。我们发现,这会造成认知缺口:当输入超出安全训练分布时,模型会自信地生成有害内容。为此,我们提出STEER(Safety Targeted Embedding Exploit via Refinement),一种基于梯度的攻击方法,通过识别导致模型拒绝的关键词,并迭代将其翻译为低资源语言,以抑制拒绝行为同时保留有害意图。在六个开源8B参数模型上,STEER在JailbreakBench上的攻击成功率达93.0%,在AdvBench上达96.7%,优于随机代码切换和贪心坐标梯度(GCG)。这些提示还可迁移至GPT-4o-mini,无需访问目标模型即实现35.5%的攻击成功率,表明该弱点并非单一架构特有。研究证明,仅以英语对齐的安全机制无法保证跨语言泛化。我们主张,提升多语言安全性需在对齐阶段扩大语言覆盖,并引入显式检测与拒绝分布外输入的机制。
原文摘要 · Abstract (English)
Safety training for large language models (LLMs) is conducted predominantly in English, leaving uncertain how well safety mechanisms generalize to low-resource languages and mixed-language code-switching. We show that this creates an epistemic gap in which models confidently generate harmful responses for inputs that fall outside the distribution of their safety training. To study this phenomenon, we introduce STEER (Safety Targeted Embedding Exploit via Refinement), a gradient-guided attack that identifies words contributing most strongly to the model's refusal behavior and iteratively translates them into low-resource languages to suppress refusal while preserving harmful intent. Across six open-source 8B-parameter models, STEER achieves attack success rates of up to 93.0% on JailbreakBench and 96.7% on AdvBench, outperforming random code-switching and Greedy Coordinate Gradient (GCG). The resulting prompts also transfer to GPT-4o-mini, achieving a 35.5% attack success rate without requiring access to the target model, suggesting that the underlying weakness is not specific to a single architecture. These findings demonstrate that safety mechanisms aligned primarily on English cannot be assumed to generalize across multilingual inputs. We argue that improving multilingual safety requires broader coverage during alignment and mechanisms that explicitly detect and abstain on out-of-distribution inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。