arXiv:2505.17519cs.CRcs.CL2025-05被引 6

用自由叙事链骗过大模型,实现无模板越狱攻击

Chain-of-Lure: A Universal Jailbreak Attack Framework using Unconstrained Synthetic Narratives

  • 通过对话转移隐藏恶意意图,生成无模板的诱骗问题链
  • 黑盒测试中对多种模型攻击成功率超90%,毒性得分显著提升
  • 适合研究模型安全与对抗攻击的开发者,揭示防御盲区

在生成式AI快速发展的背景下,大语言模型(LLMs)的交互面临日益增长的滥用风险。现有研究多聚焦于基于模板的提示攻击和优化方法,忽视了LLMs本身具备的无约束欺骗能力。本文提出一种受思维链启发的新型越狱方法——Chain-of-Lure。攻击者利用任务转移技术,在对话中隐匿有害用户意图,并生成无需预设模板的渐进式诱骗问题链,实现成功越狱。为进一步增强攻击效果,引入辅助LLM对多轮对话进行随机化叙事优化,保持原始恶意意图的同时提升攻击性能。我们还设计了一种基于第三方LLM的毒性评估框架,用于检测有害内容及其与恶意意图的一致性。大量实验表明,该方法在黑盒API设置下对多种类型的LLM均保持高攻击成功率(平均>90%)和显著提升的毒性得分。结果揭示了在缺乏强对齐约束时,LLMs具有内在的无限制攻击潜力。本研究为未来对齐机制的设计提供数据驱动洞见,并提出两种具体的防御策略以支持更安全的生成模型发展。代码已开源。

原文摘要 · Abstract (English)

In the era of rapid generative AI development, interactions with large language models (LLMs) pose increasing risks of misuse. Prior research has primarily focused on attacks using template-based prompts and optimization-oriented methods, while overlooking the fact that LLMs possess strong unconstrained deceptive capabilities to attack other LLMs. This paper introduces a novel jailbreaking method inspired by the Chain-of-Thought mechanism. The attacker employs mission transfer to conceal harmful user intent within dialogue and generates a progressive chain of lure questions without relying on predefined templates, enabling successful jailbreaks. To further improve the attack's strength, we incorporate a helper LLM model that performs randomized narrative optimization over multi-turn interactions, enhancing the attack performance while preserving alignment with the original intent. We also propose a toxicity-based framework using third-party LLMs to evaluate harmful content and its alignment with malicious intent. Extensive experiments demonstrate that our method consistently achieves high attack success rates and elevated toxicity scores across diverse types of LLMs under black-box API settings. These findings reveal the intrinsic potential of LLMs to perform unrestricted attacks in the absence of robust alignment constraints. Our approach offers data-driven insights to inform the design of future alignment mechanisms. Finally, we propose two concrete defense strategies to support the development of safer generative models. Our code is available at https://github.com/ChangWenhan/chain-of-lure-official

模型安全越狱攻击对抗样本LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。