利用权威引用漏洞,让大模型生成有害内容,攻击成功率超76%。
The Dark Side of Trust: Authority Citation-Driven Jailbreak Attacks on Large Language Models
- 设计黑盒攻击工具DarkCite,自动匹配高可信引用类型
- 在恶意指令下攻击成功率达76%,高于以往方法
- 揭示模型对权威信息的盲目信任,适合安全研究者参考
大型语言模型(LLMs)在各领域广泛应用,展现出巨大潜力的同时也暴露出显著的安全隐患。确保生成内容符合人类价值观至关重要。现有越狱技术通过特定提示或对抗后缀破坏对齐。本研究提出新威胁:LLM对权威性的固有偏倚。虽然该偏倚可提升输出质量,但也带来生成有害内容的风险。具体表现为对不同权威信息的信任度差异,如恶意代码开发中更倾向信任GitHub。为揭示风险,我们提出DarkCite——一种适用于黑盒场景的自适应权威引用匹配与生成器。它根据风险类型匹配最优引用类型并生成相关权威引用,从而更有效地越狱对齐的LLM。实验表明,DarkCite在LLama-2上实现76%的攻击成功率(此前为68%)。为应对该风险,我们提出真实性与危害性验证防御策略,将平均防御通过率(DPR)从11%提升至74%。更重要的是,引用与内容的关联已成为LLM的基础功能,进一步放大了模型对权威的偏倚影响。
原文摘要 · Abstract (English)
The widespread deployment of large language models (LLMs) across various domains has showcased their immense potential while exposing significant safety vulnerabilities. A major concern is ensuring that LLM-generated content aligns with human values. Existing jailbreak techniques reveal how this alignment can be compromised through specific prompts or adversarial suffixes. In this study, we introduce a new threat: LLMs' bias toward authority. While this inherent bias can improve the quality of outputs generated by LLMs, it also introduces a potential vulnerability, increasing the risk of producing harmful content. Notably, the biases in LLMs is the varying levels of trust given to different types of authoritative information in harmful queries. For example, malware development often favors trust GitHub. To better reveal the risks with LLM, we propose DarkCite, an adaptive authority citation matcher and generator designed for a black-box setting. DarkCite matches optimal citation types to specific risk types and generates authoritative citations relevant to harmful instructions, enabling more effective jailbreak attacks on aligned LLMs.Our experiments show that DarkCite achieves a higher attack success rate (e.g., LLama-2 at 76% versus 68%) than previous methods. To counter this risk, we propose an authenticity and harm verification defense strategy, raising the average defense pass rate (DPR) from 11% to 74%. More importantly, the ability to link citations to the content they encompass has become a foundational function in LLMs, amplifying the influence of LLMs' bias toward authority.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。