用学习方法自动发现大模型安全漏洞,效率比人工高3.9倍。
Learning-Based Automated Adversarial Red-Teaming for Robustness Evaluation of Large Language Models
- 基于安全种子,通过元提示和演化搜索生成攻击
- 在6类威胁中发现47个漏洞,含21个高危项
- 可避免模板重复,覆盖所有威胁类别,适合安全评估
红队测试正成为大语言模型安全评估的核心手段,但当前仍依赖专家编写提示或固定基准集,导致测试内容与实际风险脱节:潜在缺陷可能稀少、依赖上下文且分布于多种威胁类型中。本文将自动化红队测试视为受限的对抗搜索问题,提出一种融合类别感知攻击生成与分层漏洞检测的学习驱动框架。该方法从精选的安全种子出发,通过元提示引导和演化搜索扩展,并利用词汇、语义及行为检测器对生成的提示-响应对进行评分。在GPT-OSS-20B上针对六类威胁,共发现47个已验证漏洞,包括21个高危案例和12种新攻击模式。在相同查询预算下,其漏洞发现率比人工红队高出3.9倍,同时保持89%的检测准确率和完整类别覆盖。消融实验表明,性能提升并非仅因更多提示:多样性约束防止模板坍缩,覆盖率约束避免类别盲区,语义检测则弥补了词汇规则遗漏的失败。结果表明,将红队测试视为自适应搜索而非静态清单,可显著提升其可扩展性与可复现性。
原文摘要 · Abstract (English)
Red-teaming is becoming a central part of large language model (LLM) safety evaluation, yet current practice still relies heavily on expert-written prompts or fixed benchmark suites. This creates a gap between what is easy to test and what deployed models can actually do: failures may be rare, context-sensitive, and distributed across many threat categories. We study automated red-teaming as a constrained adversarial search problem and introduce a learning-driven framework that couples category-aware attack generation with hierarchical vulnerability detection. The method starts from curated safety seeds, expands them through meta-prompt-guided and evolutionary search, and scores the resulting prompt--response pairs with lexical, semantic, and behavioral detectors. Across six threat categories on GPT-OSS-20B, the framework discovers 47 validated vulnerabilities, including 21 high-severity cases and 12 novel attack patterns. Under matched query budgets, it achieves a 3.9$\times$ higher discovery rate than manual expert red-teaming while maintaining 89\% detection accuracy and full category coverage. Ablations show that the gains do not come from more prompts alone: diversity constraints prevent template collapse, coverage constraints prevent category blind spots, and semantic detection recovers failures missed by lexical rules. These results suggest that red-teaming can be made more scalable and reproducible when treated as adaptive search rather than as a static checklist.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。