arXiv:2603.14355cs.CL2026-03中稿 · Transactions on Ma…被引 2

通过多样化采样暴露大模型长尾安全漏洞,效率更高。

Exposing Long-Tail Safety Failures in Large Language Models through Efficient Diverse Response Sampling

  • 用多阶段多样性采样替代盲目大规模生成,更高效发现隐蔽安全漏洞。
  • 在有限计算成本下,攻击成功率比传统方法高26%-40%。
  • 适合安全评测、模型加固研究者使用,尤其关注罕见失效场景。

通过监督微调和基于人类反馈的强化学习,大语言模型的安全性已显著提升,但通常只是压制而非消除不安全行为,导致输出分布长尾中的罕见但关键缺陷仍被隐藏。现有红队测试多聚焦于对抗性提示搜索,而本文表明,通过生成多样化的响应可系统性暴露这些隐藏风险。具体而言,对于固定的安全敏感提示,增加采样数量与多样性会单调提升越狱成功率。为此,提出渐进式多样群体采样(PDPS),以多阶段扩展与筛选策略替代传统的大量独立同分布采样,在大幅降低计算成本的同时生成语义多样且紧凑的响应集合。在多个越狱基准与开源LLM上,PDPS在仅使用8%-29%计算量的情况下达到与大规模IID采样相当的攻击成功率,并在受限响应预算下优于IID采样与多样束搜索26%-40%;同时揭示更广泛、更丰富的失败模式。更重要的是,该多样性直接提升安全强化效果:当集成到基于RLHF的安全微调流程中,由PDPS生成的不安全响应使平均安全率(ASR)下降幅度分别比IID采样和多样束搜索高出33%和41%。最后,尽管仅靠输入空间提示优化无法覆盖输出空间探索,但结合两者可更高效地覆盖更广泛的失败模式。

原文摘要 · Abstract (English)

Safety tuning through supervised fine-tuning and reinforcement learning from human feedback has substantially improved the robustness of large language models. However, it typically suppresses rather eliminates unsafe behaviors, leaving rare but critical failures hidden in the long tail of the output distribution. While most red-teaming work emphasizes adversarial prompt search, we show that these hidden risks can be systematically exposed through diverse response generation. Specifically, we show that, for a fixed safety-critical prompt, increasing the number and diversity of sampled responses monotonically raises the jailbreak success rate. To efficiently uncover these failures, we propose Progressive Diverse Population Sampling (PDPS). This approach replaces naive, large-scale IID sampling with a multi-stage expansion-and-selection strategy that generates a compact, semantically diverse set of responses at a substantially lower computational cost. Across multiple jailbreak benchmarks and open-source LLMs, PDPS achieves attack success rates comparable to large-scale IID sampling while using only 8%-29% of the computational cost, and outperforms IID sampling and Diverse Beam Search by 26%-40% under limited-response budgets, while uncovering a broader and more semantically diverse range of failure modes. Critically, this diversity translates directly into more effective safety hardening: when integrated into an RLHF-based safety-tuning pipeline, PDPS-generated unsafe responses yield 33% and 41% greater reductions in ASR than those generated by IID sampling and Diverse Beam Search, respectively. Finally, we show that while input-space prompt optimization methods fall short of output-space exploration when used in isolation, combining input-space perturbation with diversity-driven output-space exploration covers a wider range of failure modes more efficiently than either paradigm alone.

安全评测多样性采样越狱检测模型加固

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。