arXiv:2602.11157cs.CL2026-02被引 4

用知识蒸馏提升多语言模型安全,反而让攻击成功率上升16.6个百分点。

Response-Based Knowledge Distillation for Multilingual Jailbreak Prevention Unwittingly Compromises Safety

  • 通过黑盒响应蒸馏,将大模型拒绝行为迁移到开源小模型
  • 蒸馏后所有学生模型的越狱成功率最高提升16.6个百分点
  • 移除模糊拒绝可缓解安全下降,适合研究多语言安全对齐者

大型语言模型在全球部署日益广泛,但其安全对齐仍以英语为主,导致非英语尤其是低资源语言存在漏洞。本文首次将知识蒸馏(KD)应用于多语言越狱防御,使用约28,000条来自XSafety的多语言越狱提示,通过基于响应的黑盒参数高效微调(PEFT),将专有教师模型(OpenAI o1-mini)的拒绝行为以低秩适配(LoRA)方式迁移到三个开源学生模型:Meta-Llama-3-8B-Instruct、Gemma-2-2B-IT 和 Qwen3-8B。在MultiJail基准上的评估发现反直觉现象:在教师模型的“安全”拒绝数据上进行标准微调,反而使所有学生模型的越狱成功率(JSR)提升,最高达16.6个百分点。实验揭示蒸馏过程中对未见语言的泛化差异,结果随基础模型而异。通过移除主要的安全退化来源——模糊‘边界’拒绝,可缓解甚至逆转学生模型的安全下降,尽管推理性能(GSM8K)仍受影响。本探索性研究揭示了知识蒸馏在多语言安全对齐中的挑战与潜力,为未来研究提供基础。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly deployed worldwide, yet their safety alignment remains predominantly English-centric. This allows for vulnerabilities in non-English contexts, especially with low-resource languages. We introduce a novel application of knowledge distillation (KD) in the context of multilingual jailbreak prevention, examining its efficacy. We distill the refusal behaviors of a proprietary teacher model (OpenAI o1-mini) with Low-Rank Adaptation (LoRA) into three open-source student models: Meta-Llama-3-8B-Instruct, Gemma-2-2B-IT, and Qwen3-8B, using ~28,000 multilingual jailbreak prompts from XSafety via black-box response-based, parameter-efficient fine-tuning (PEFT). Evaluation on the MultiJail benchmark reveals a counterintuitive behavior: standard fine-tuning on the teacher's ``safe'' refusal data inadvertently increases Jailbreak Success Rate (JSR) for all student models, up to 16.6 percentage points. Our experiments reveal a divergent generalization to unseen languages during distillation, with varying outcomes depending on the base model. By removing a primary source of safety degradation, nuanced `boundary' refusals, we mitigate or even reverse safety declines in student models, although reductions in reasoning performance (GSM8K) persist. Overall, our exploratory study highlights the challenges and potential of KD as a technique for multilingual safety alignment, offering a foundation for future research in this direction.

多语言知识蒸馏安全对齐越狱防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。