arXiv:2605.19377cs.LGcs.AI2026-05

用博弈论框架重新定义大模型安全评估,揭示微调的局部泛化特性。

The Evaluation Game: Beyond Static LLM Benchmarking

论文配图:The Evaluation Game: Beyond Static LLM Benchmarking
图 1 · 摘自论文原文
  • 将评估者与训练者建模为博弈双方,用群作用形式化数据增强
  • 实验证明微调仅带来局部泛化,拒答率与提示距离高度相关
  • 强调动态评估必要性,静态基准无法区分真实修复与记忆漏洞

随着针对大语言模型的安全绕过攻击(jailbreak)持续被发现,从业者越来越多地依赖微调作为防御策略。然而,这种鲁棒性微调的理论基础仍不明确。本文提出一种博弈论框架,将评估者(检测绕过攻击)与训练者之间的互动形式化为二人博弈。关键在于使用群作用——一种捕捉对称性与变换的数学结构——来形式化数据增强。最简单的非平凡情形是循环平移群上的圆结构,其表现出不同训练泛化范围下的多种行为模式:低于临界阈值时,评估者在许多轮中保持恒定误检率;其他设置则呈现显著差异。我们进一步提供了实证证据,支持模型存在局部依赖性:在测试的三个模型族(Llama、Qwen、Mistral)中,基于对抗提示微调仅引发局部泛化,测试样本的拒答率与微调提示的距离高度相关。本框架重新定义了对抗评估的核心对象:基准不是静态提示集,而是评估者群作用下的轨道;忽略训练侧适应性的审计协议无法区分真正的修复与记忆化的补丁。

原文摘要 · Abstract (English)

As jailbreaks, adversarially crafted inputs that bypass safety constraints, continue to be discovered in Large Language Models, practitioners increasingly rely on fine-tuning as a defensive strategy. Yet the theoretical foundations underlying this robustness fine-tuning remain underexplored. We introduce a game-theoretic framework in which the interaction between an evaluator (auditing the model for jailbreaks) and a trainer is formalized as a two-player game. A key feature of our approach is the use of group actions, a mathematical structure that captures symmetries and transformations, to formally represent data augmentation. The simplest non-trivial instance is the circle with cyclic translation groups, where we exhibit various regimes depending on the trainer's generalization range. Below a critical threshold, the evaluator maintains a constant miss ratio for linearly many rounds, whereas other settings can yield very different behaviors. We further provide empirical evidence supporting locality-dependence of the model: for the three model families we tested (Llama, Qwen and Mistral), we have significant evidence that fine-tuning on adversarial prompts induces only local generalization, with refusal rates on test examples highly correlated with the distance to the fine-tuning prompts. Our framework recasts the central object of adversarial evaluation: a benchmark is not a static set of prompts but an orbit under the evaluator's group action, and audit protocols that ignore trainer-side adaptation cannot distinguish a genuine fix from a memorized patch.

大模型安全对抗评估微调机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。