用分解评分法精准判断越狱攻击是否成功,避免人工误判。
JADES: A Universal Framework for Jailbreak Assessment via Decompositional Scoring
- 将有害问题拆解为加权子问题,逐个评分后聚合决策。
- 在400组数据上与人类评估一致率达98.5%,优于基线超9%。
- 可发现模型越狱攻击被严重高估,适合安全研究者使用。
准确判断越狱攻击是否成功是一个基础但未解决的挑战。现有评估方法依赖不匹配的代理指标或简单的整体判断,常误读模型响应,导致评估结果不一致且主观,与人类认知不符。为此,我们提出JADES(基于分解评分的越狱评估框架),其核心机制是自动将有害输入分解为一组加权子问题,分别评分并加权聚合得到最终结论。JADES还包含可选的事实核查模块,以增强对越狱响应中幻觉的检测能力。我们在本文提出的全新基准JailbreakQR上验证JADES,该基准包含400对经过人工精细标注的越狱提示与响应。在二分类任务(成功/失败)中,JADES与人类评估者达成98.5%的一致性,显著优于强基线超过9%。重新评估五种主流攻击在四类大模型上的表现,发现存在明显高估现象(例如,LAA攻击在GPT-3.5-Turbo上的成功率从93%降至69%)。结果表明,JADES能提供准确、一致且可解释的评估,为未来越狱攻击的衡量奠定可靠基础。
原文摘要 · Abstract (English)
Accurately determining whether a jailbreak attempt has succeeded is a fundamental yet unresolved challenge. Existing evaluation methods rely on misaligned proxy indicators or naive holistic judgments. They frequently misinterpret model responses, leading to inconsistent and subjective assessments that misalign with human perception. To address this gap, we introduce JADES (Jailbreak Assessment via Decompositional Scoring), a universal jailbreak evaluation framework. Its key mechanism is to automatically decompose an input harmful question into a set of weighted sub-questions, score each sub-answer, and weight-aggregate the sub-scores into a final decision. JADES also incorporates an optional fact-checking module to strengthen the detection of hallucinations in jailbreak responses. We validate JADES on JailbreakQR, a newly introduced benchmark proposed in this work, consisting of 400 pairs of jailbreak prompts and responses, each meticulously annotated by humans. In a binary setting (success/failure), JADES achieves 98.5% agreement with human evaluators, outperforming strong baselines by over 9%. Re-evaluating five popular attacks on four LLMs reveals substantial overestimation (e.g., LAA's attack success rate on GPT-3.5-Turbo drops from 93% to 69%). Our results show that JADES could deliver accurate, consistent, and interpretable evaluations, providing a reliable basis for measuring future jailbreak attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。