arXiv:2602.02280cs.SEcs.AI2026-02

提出新型覆盖标准RACC,精准评估大模型安全测试质量。

RACC: Representation-Aware Coverage Criteria for LLM Safety Testing

  • 基于安全表征提取,识别关键风险概念方向。
  • 六项指标衡量测试用例对安全概念的覆盖程度。
  • 可指导测试优先级排序与攻击样本生成,适用性强。

大语言模型面临严重的越狱攻击安全风险,但现有安全测试多依赖静态数据集,缺乏系统性标准来评估测试集的质量与充分性。尽管覆盖准则在小型神经网络中有效,但因其计算开销大且安全信号与无关神经元激活纠缠,难以适用于大语言模型。为此,我们提出专用于大模型安全测试的覆盖准则RACC:首先利用少量有害提示校准集从模型隐藏状态中提取安全表征,再测量测试提示对这些表征方向的激活程度,并通过六项准则评估单一及组合安全概念的覆盖情况。在多个大模型和安全基准上的实验表明,RACC能可靠奖励高质量越狱测试集,同时对冗余或无效输入不敏感,这是传统神经元级准则所不具备的关键优势。我们进一步验证了RACC在测试集优先级排序与攻击提示采样中的实用价值,并证明其在不同设置与配置下的泛化能力。总体而言,RACC为覆盖引导的大模型安全测试提供了可扩展且有原则的基础。

原文摘要 · Abstract (English)

Large Language Models (LLMs) face severe safety risks from jailbreak attacks, yet current safety testing largely relies on static datasets and lacks systematic criteria to evaluate test suite quality and adequacy. While coverage criteria have proven effective for smaller neural networks, they are impractical for LLMs due to computational overhead and the entanglement of safety-critical signals with irrelevant neuron activations. To address these issues, we propose RACC (Representation-Aware Coverage Criteria), a set of coverage criteria specialized for LLM safety testing. RACC first extracts safety representations from the LLM's hidden states using a small calibration set of harmful prompts, then measures test prompts' concept activations against these directions, and finally computes coverage through six criteria assessing both individual and compositional safety concept coverage. Experiments on multiple LLMs and safety benchmarks show that RACC reliably rewards high-quality jailbreak test suites while remaining insensitive to redundant or invalid inputs, which is a key distinction that neuron-level criteria fail to make. We further demonstrate RACC's practical value in two applications, including test suite prioritization and attack prompt sampling, and validate its generalization across diverse settings and configurations. Overall, RACC provides a scalable and principled foundation for coverage-guided LLM safety testing.

大模型安全测试评估覆盖准则越狱攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。