arXiv:2412.15289cs.CRcs.AI2024-12ACL被引 15

通过简单辅助任务链接绕过LLM安全机制,高效生成有害内容

SATA: A Paradigm for LLM Jailbreak via Simple Assistive Task Linkage

  • 用掩码词+辅助任务隐晦传递恶意指令
  • 在AdvBench上攻击成功率超85%,有害得分达4.57
  • 无需复杂提示设计,适合研究模型安全漏洞

大型语言模型(LLMs)在多项任务中取得显著进展,但其安全对齐仍是重大挑战。探索越狱提示可暴露LLM的脆弱性并指导防护。现有方法多依赖复杂的指令设计或多次迭代,影响越狱效率。本文提出一种新范式——简单辅助任务链接(SATA),可有效绕过LLM安全机制并诱导有害响应。SATA首先将恶意查询中的敏感词掩码为[MASK],生成相对无害的查询;随后采用掩蔽语言模型(MLM)或按位置元素查找(ELP)等简单辅助任务编码被掩码词语义;最后将辅助任务与掩码查询联合执行越狱。大量实验表明,SATA性能达到当前最优:在AdvBench数据集上,使用MLM任务时整体攻击成功率(ASR)达85%,有害得分(HS)为4.57;使用ELP任务时,整体ASR为76%,HS为4.43。

原文摘要 · Abstract (English)

Large language models (LLMs) have made significant advancements across various tasks, but their safety alignment remain a major concern. Exploring jailbreak prompts can expose LLMs' vulnerabilities and guide efforts to secure them. Existing methods primarily design sophisticated instructions for the LLM to follow, or rely on multiple iterations, which could hinder the performance and efficiency of jailbreaks. In this work, we propose a novel jailbreak paradigm, Simple Assistive Task Linkage (SATA), which can effectively circumvent LLM safeguards and elicit harmful responses. Specifically, SATA first masks harmful keywords within a malicious query to generate a relatively benign query containing one or multiple [MASK] special tokens. It then employs a simple assistive task such as a masked language model task or an element lookup by position task to encode the semantics of the masked keywords. Finally, SATA links the assistive task with the masked query to jointly perform the jailbreak. Extensive experiments show that SATA achieves state-of-the-art performance and outperforms baselines by a large margin. Specifically, on AdvBench dataset, with mask language model (MLM) assistive task, SATA achieves an overall attack success rate (ASR) of 85% and harmful score (HS) of 4.57, and with element lookup by position (ELP) assistive task, SATA attains an overall ASR of 76% and HS of 4.43.

LLM安全越狱攻击提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。