用隐喻角色伪装攻击大模型,突破安全限制。
Na'vi or Knave: Jailbreaking Language Models via Metaphorical Avatars
- 通过隐喻将有害内容转化为看似无害的虚构角色
- 在多个主流大模型上实现高成功率越狱攻击
- 揭示大模型想象力背后的安全部署风险
隐喻是一种隐含的信息传递方式,有助于理解复杂概念。然而,它也可能被用于绕过大型语言模型(LLMs)的安全对齐机制,导致有害知识泄露。本文提出一种新型攻击框架——AVATAR(Jailbreak via Adversarial Metaphor),利用大模型的想象力实现越狱。具体而言,AVATAR从目标有害内容中提取关键实体,并基于大模型的想象将其映射为看似无害的对抗性虚构实体;随后,以这些隐喻角色为基础,构建拟人化交互情境,动态诱导模型输出有害响应。实验表明,该方法能有效且可迁移地攻破多种先进大模型,达到当前最优攻击成功率。研究揭示了大模型因内在想象力而存在的安全风险,分析还指出其对对抗性隐喻的脆弱性,强调需发展针对此类越狱攻击的防御机制。警告:本文包含可能有害的大模型生成内容。
原文摘要 · Abstract (English)
Metaphor serves as an implicit approach to convey information, while enabling the generalized comprehension of complex subjects. However, metaphor can potentially be exploited to bypass the safety alignment mechanisms of Large Language Models (LLMs), leading to the theft of harmful knowledge. In our study, we introduce a novel attack framework that exploits the imaginative capacity of LLMs to achieve jailbreaking, the J\underline{\textbf{A}}ilbreak \underline{\textbf{V}}ia \underline{\textbf{A}}dversarial Me\underline{\textbf{TA}} -pho\underline{\textbf{R}} (\textit{AVATAR}). Specifically, to elicit the harmful response, AVATAR extracts harmful entities from a given harmful target and maps them to innocuous adversarial entities based on LLM's imagination. Then, according to these metaphors, the harmful target is nested within human-like interaction for jailbreaking adaptively. Experimental results demonstrate that AVATAR can effectively and transferablly jailbreak LLMs and achieve a state-of-the-art attack success rate across multiple advanced LLMs. Our study exposes a security risk in LLMs from their endogenous imaginative capabilities. Furthermore, the analytical study reveals the vulnerability of LLM to adversarial metaphors and the necessity of developing defense methods against jailbreaking caused by the adversarial metaphor. \textcolor{orange}{ \textbf{Warning: This paper contains potentially harmful content from LLMs.}}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。