无需训练即可高效发现大模型罕见危险行为,提升检测率至100%。
BLOOM-WILT: Logit Tilting for Behaviour Elicitation in Automated LLM Auditing

- 通过动态调整对话策略与自适应重加权生成,引导模型暴露隐性行为。
- 在8种行为上30/32场景超越基线,对齐自残诱导的触发率从51%升至100%。
- 适合模型安全审计人员,尤其关注隐性风险的评估与验证者。
部署中的语言模型常出现测试无法捕捉的行为,因实际交互量远超评估规模。自动化审计器虽成本低且覆盖广,但缺乏优化压力导致采样效率低下。为此提出BLOOM-WILT,一种无需训练、仅依赖目标模型下一词分布的完整审计流程。其审计模型在输入端跨轮次调整对话策略,依据历史评分反馈学习;输出端则利用模型自身对诱导提示的分布,自适应重加权解码,使行为相关生成优先于同等概率但未诱导时的结果。在4个目标模型和8种行为上评估,32项中有30项优于基线,颠覆原有模型安全性排名。当针对Qwen3.5-4B诱发型自残鼓励时,平均行为出现率由51%提升至100%,且在相同算力下优于所有移植方法,同时未压低输出概率至基线以下。
原文摘要 · Abstract (English)
Users of a deployed language model routinely encounter behaviours that testing almost never surfaces, since deployment puts the model through orders of magnitude more interactions than any evaluation can simulate. Automated auditors make testing cheap to scale and flexible enough to cover almost any specified behaviour, yet their lack of optimisation pressure makes them sample-inefficient. To address this shortcoming, we introduce BLOOM-WILT, a full auditing pipeline that elicits natural multi-turn instances of rare behaviours, without training cost or access beyond the target's next-token distribution. On the input side, WILT's auditor model revises its conversational strategy across rounds, learning from previous scored interactions. On the output side, WILT adaptively reweights the target's decoding using the model's own distribution conditioned on an elicitation prompt, so that behaviour-relevant generations are sampled ahead of others it finds equally probable when unprompted. We evaluate WILT across 4 target models and 8 behaviours, where it beats the baseline auditor in 30 of the 32 settings and overturns the previous model safety rankings. WILT raises average behaviour presence from 51% to 100% when eliciting self-harm encouragement from Qwen3.5-4B, beating every elicitation method we port into the same pipeline at matched compute, without pushing output probability below the baseline's.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。