arXiv:2603.23171cs.CRcs.AI2026-03被引 1

用激活水印技术让大模型监控防得住恶意攻击者,还能定位违规行为。

Adaptively Robust LLM Monitoring via Activation Watermarking

  • 通过隐藏状态对齐密钥方向实现随机化监控,提升对抗能力。
  • 在1%误报率下,攻击者逃逸率降低超50%,且能准确识别违规策略。
  • 适合关注模型安全、合规监控的团队使用。

模型服务商需监控已部署的大语言模型以检测无法阻止的滥用行为。当前监控方式为确定性且公开,具备本地副本的自适应攻击者可离线搜索触发有害响应的提示,从而规避检测。此类攻击尤为危险,因服务方从未观察到滥用行为,无法事后修补防御。核心挑战在于抵御自适应攻击的同时保持对非自适应攻击的检测率。本文提出激活水印(Activation Watermarking, AWM),通过有限微调使模型在违反策略时其隐藏状态与秘密密钥导出的方向对齐。检测基于服务商已计算的激活值进行相似性测试,攻击者即使知晓所有信息但未知密钥,也必须针对不同密钥的代理检测器优化。在匹配1%误报率下,基于代理的攻击在所有评估基线中至少79%时间成功逃逸,而AWM将其逃逸率减半以上。此外,AWM在四个非自适应越狱家族中的三个表现最佳,仅在七个基准上带来小幅效用损失。由于高维空间中随机方向近似正交,每条策略对应一个水印即可实现溯源。在20个监控策略中,AWM对违规策略的识别准确率达80%,远超5%的随机基准。AWM具有(i)高效性、(ii)对自适应攻击显著更强的鲁棒性,以及(iii)策略溯源能力。

原文摘要 · Abstract (English)

Providers monitor deployed large language models (LLMs) to detect misuse that they cannot prevent. LLM monitoring is deterministic and often openly available, so $\emph{adaptive}$ attackers with a local copy can search offline for prompts that elicit harmful behavior and evade detection. These attacks are especially concerning because providers never observe the misuse and cannot patch their defenses post-hoc. The core challenge is resisting adaptive attackers while preserving detection rates against non-adaptive ones. We propose $\emph{Activation Watermarking}$ (AWM), which randomizes monitoring through limited fine-tuning that aligns the LLM's hidden states with a secret key-derived direction whenever a response violates a policy. Detection is a similarity test on activations the provider already computes, and attackers who know everything but the key must optimize against differently keyed surrogate detectors. At a matched $1\%$ false-positive rate, such surrogate-based attacks evade every evaluated baseline at least $79\%$ of the time, but AWM more than halves this evasion rate. AWM also achieves the lowest evasion rate on three of four non-adaptive jailbreak families at a small drop in utility measured across seven benchmarks. Because random high-dimensional directions are near-orthogonal, assigning one watermark per policy enables attribution. Across 20 monitored policies, AWM identifies the violated policy with $80\%$ accuracy versus a $5\%$ chance baseline. AWM is (i) efficient, (ii) substantially more robust against adaptive attackers than related work and (iii) can attribute which policies were violated.

模型安全水印技术监控机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。