arXiv:2504.01278cs.AI2025-04被引 14

提出多轮对抗智能体,能动态学习并适应攻击策略。

Strategize Globally, Adapt Locally: A Multi-Turn Red Teaming Agent with Dual-Level Learning

  • 分全局与局部双层学习,持续积累攻击知识并优化具体提示。
  • 5轮内对GPT-3.5-Turbo和Llama-3.1-70B攻击成功率超90%。
  • 适合研究模型安全与对抗攻击的开发者参考。

大型语言模型(LLMs)被滥用于恶意目的带来的安全风险日益严重。现有红队测试框架多聚焦单轮攻击,而真实攻击者常在多轮对话中迭代探测漏洞并根据响应调整提示。本文提出 extsc{AlgName},一种新型多轮红队智能体,通过互补的学习机制模拟高级人类攻击者:全局层面积累长期知识并泛化至新攻击目标;局部层面在初始尝试失败时细化特定目标的提示实现。不同于依赖固定策略集的现有方法, extsc{AlgName}可自主发现新越狱策略,构建基于目标的策略选择框架,并优化选定策略的提示形式。在JailbreakBench上的实证评估表明,该框架在5轮对话内对GPT-3.5-Turbo和Llama-3.1-70B的攻击成功率均超过90%,显著优于现有最优基线。结果验证了动态学习在真实多轮场景中识别与利用模型漏洞的有效性。

原文摘要 · Abstract (English)

The exploitation of large language models (LLMs) for malicious purposes poses significant security risks as these models become more powerful and widespread. While most existing red-teaming frameworks focus on single-turn attacks, real-world adversaries typically operate in multi-turn scenarios, iteratively probing for vulnerabilities and adapting their prompts based on threat model responses. In this paper, we propose \AlgName, a novel multi-turn red-teaming agent that emulates sophisticated human attackers through complementary learning dimensions: global tactic-wise learning that accumulates knowledge over time and generalizes to new attack goals, and local prompt-wise learning that refines implementations for specific goals when initial attempts fail. Unlike previous multi-turn approaches that rely on fixed strategy sets, \AlgName enables the agent to identify new jailbreak tactics, develop a goal-based tactic selection framework, and refine prompt formulations for selected tactics. Empirical evaluations on JailbreakBench demonstrate our framework's superior performance, achieving over 90\% attack success rates against GPT-3.5-Turbo and Llama-3.1-70B within 5 conversation turns, outperforming state-of-the-art baselines. These results highlight the effectiveness of dynamic learning in identifying and exploiting model vulnerabilities in realistic multi-turn scenarios.

红队攻击多轮对抗模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。