arXiv:2506.17231cs.CLcs.CR2025-06被引 5

用小模型复刻大模型的越狱能力,攻击更高效隐蔽。

Efficient and Stealthy Jailbreak Attacks via Adversarial Prompt Distillation from LLMs to SLMs

  • 将大模型的越狱能力蒸馏到小模型,降低资源消耗。
  • 在12个模型上实现最高96.4%的越狱成功率,速度提升3.7倍。
  • 适合研究模型安全与防御机制的学者使用。

当前针对大语言模型(LLMs)的越狱攻击主要依赖LLM自身生成对抗性提示,导致计算开销巨大,难以扩展和部署。为此,我们提出对抗性提示蒸馏(APD)框架,将越狱能力从LLMs迁移到小语言模型(SLMs),实现高效、低资源的攻击。APD包含三个核心组件:(1) 基于LoRA微调的掩码对抗知识预训练;(2) 动态温度控制的知识蒸馏以弥合架构差异;(3) 基于强化学习的模板优化实现自适应精炼。在12个模型上的实验表明,APD在保持顶尖攻击成功率(如GPT-4上达到96.4%的ASR_k)的同时,生成提示速度提升3.7倍,参数量减少11.3倍。本工作首次构建了轻量化越狱攻击的实用框架,揭示了大模型防御的新漏洞,并为人工智能安全研究提供了可扩展测试平台。代码已开源:https://github.com/lxgem/Efficient_and_Stealthy_Jailbreak_Attacks_via_Adversarial_Prompt。

原文摘要 · Abstract (English)

Current jailbreak attacks on large language models (LLMs) predominantly rely on LLMs themselves to generate adversarial prompts, creating a critical efficiency bottleneck: each attack requires substantial computational resources and API queries, limiting scalability and practical deployment. To overcome this limitation, we propose Adversarial Prompt Distillation (APD), a novel framework that transfers jailbreaking capabilities from LLMs to small language models (SLMs) for efficient, low-resource attacks. APD integrates three key components: (1) masked adversarial knowledge pre-training via LoRA fine-tuning, (2) dynamic temperature-controlled knowledge distillation to bridge architectural gaps, and (3) reinforcement learning-based template optimization for adaptive refinement. Extensive experiments across 12 models show that APD achieves state-of-the-art attack success rates (e.g., 96.4% ASR_k on GPT-4) while dramatically improving efficiency - generating prompts 3.7x faster with 11.3x fewer parameters than teacher models. Our work establishes the first practical framework for lightweight jailbreak attacks, exposes new vulnerabilities in LLM defenses, and provides a scalable testbed for advancing AI safety research. Our code is available at: https://github.com/lxgem/Efficient_and_Stealthy_Jailbreak_Attacks_via_Adversarial_Prompt.

越狱攻击模型蒸馏AI安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。