arXiv:2509.12937cs.CRcs.AI2025-09中稿 · presentation in th…被引 2

通过逐步具体化,让大模型生成更危险的恶意代码。

Jailbreaking Large Language Models Through Content Concretization

  • 将抽象攻击请求逐步转为可执行代码,分两阶段迭代优化。
  • 三次迭代后越狱成功率从7%升至62%,每提示成本仅7.5美分。
  • 生成代码几乎无需修改即可运行,适合安全测试与防御研究。

大型语言模型(LLMs)在任务自动化和内容生成中广泛应用,但其安全机制仍易受越狱技术攻击。本文提出一种新越狱方法——内容具体化(Content Concretization, CC),通过迭代将抽象的恶意请求转化为具体可执行的实现。该方法分为两阶段:首先使用安全约束较弱的低层级模型生成初步响应,再由高层级模型结合原始提示与前序输出进行优化。我们在350个网络安全相关提示上评估该方法,结果显示越狱成功率从无优化时的7%提升至三次迭代后的62%,每提示成本仅为7.5美分。跨九种LLM评估器的A/B对比测试表明,经优化输出在恶意程度和技术质量上均持续更高。人工代码分析显示生成代码可几乎零修改直接执行,尽管最佳效果需针对目标场景微调。结果揭示了当前大模型安全框架的关键漏洞。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly deployed for task automation and content generation, yet their safety mechanisms remain vulnerable to circumvention through different jailbreaking techniques. In this paper, we introduce \textit{Content Concretization} (CC), a novel jailbreaking technique that iteratively transforms abstract malicious requests into concrete, executable implementations. CC is a two-stage process: first, generating initial LLM responses using lower-tier, less constrained safety filters models, then refining them through higher-tier models that process both the preliminary output and original prompt. We evaluate our technique using 350 cybersecurity-specific prompts, demonstrating substantial improvements in jailbreak Success Rates (SRs), increasing from 7\% (no refinements) to 62\% after three refinement iterations, while maintaining a cost of 7.5\textcent~per prompt. Comparative A/B testing across nine different LLM evaluators confirms that outputs from additional refinement steps are consistently rated as more malicious and technically superior. Moreover, manual code analysis reveals that generated outputs execute with minimal modification, although optimal deployment typically requires target-specific fine-tuning. With eventual improved harmful code generation, these results highlight critical vulnerabilities in current LLM safety frameworks.

越狱攻击代码生成安全漏洞大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。