arXiv:2605.26526cs.LGcs.CR2026-05被引 1

现有大模型防护机制易被简单指令攻击,无需微调即可触发有害行为。

Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks

论文配图:Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks
图 1 · 摘自论文原文
  • 用指令删除和预填充等非优化攻击,绕过防护机制。
  • 攻击成功率从不足10%提升至16%-96%,在多个评测集上验证。
  • 提出新训练方法ART,可叠加现有防护,降低攻击成功率10%-20%。

近期针对开放权重大语言模型的防护机制旨在防止恶意使用。这些防护基于一个假设:有害行为需通过微调学习,而非通过提示词劫持(jailbreaking)激发。然而,预训练模型已包含大量跨领域的有害知识,这引发关键问题:攻击者能否在不进行微调的情况下,通过提示词劫持来实现有害用途?本文表明,开放权重防护机制对简单策略仍脆弱。我们评估了两种低成本攻击——指令删除和预填充,它们不依赖梯度优化。在BeaverTails、HarmBench和AdvBench三个有害性评测基准上,攻击成功率从低于10%提升至16%-96%。为缓解此漏洞,我们提出抗指令删除微调(ART),将指令删除目标纳入训练。ART可叠加于现有防御之上,使指令删除、预填充及其组合攻击成功率降低10%-20%。研究揭示开放权重模型的攻击面比以往认知更广,防御评估应涵盖更多样化的攻击策略,而不仅是对抗性微调。

原文摘要 · Abstract (English)

Recent defenses for safeguarding open-weight large language models (LLMs) are intended to prevent adversarial usage. Underlying these defenses is an assumption that new harmful behavior is learned through fine-tuning rather than elicited by jailbreaking the model. Yet, pretrained LLMs already encode substantial harmful knowledge across many domains, which raises an important question: can an adversary jailbreak safeguarded models, to achieve harmful usage without fine-tuning at all? In this paper, we show that open-weight safeguards are susceptible to simpler strategies that, despite being well known, have not been systematically evaluated against these safeguards. Specifically, we evaluate two low-cost attacks--abliteration and prefilling--that do not rely on gradient-based optimization. Across three harmfulness evaluation benchmarks (BeaverTails, HarmBench, and AdvBench), these attacks increase attack success rates against safeguarded open-weight models from below 10\% to a range of 16%-96%. To mitigate this vulnerability, we introduce abliteration-resistant tuning (ART), which incorporates an abliteration-based objective into training. ART can be layered onto existing defenses and reduces the success rates of abliteration, prefilling, and their combination by 10%-20%. These findings indicate that the attack surface for open-weight models is broader than previously characterized, and that evaluations of safeguarding defenses should incorporate a more diverse set of attack strategies beyond adversarial fine-tuning.

大模型安全提示劫持防御机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。