arXiv:2608.26222cs.LGcs.AI2026-08

用安全神经元指导模糊测试,高效发现大模型越狱漏洞。

NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation

论文配图:NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation
图 1 · 摘自论文原文
  • 利用模型内部安全神经元生成连续反馈,替代传统响应评估。
  • 在21个模型上实现76%-100%越狱攻击发现率,最高超基线48个百分点。
  • 可零样本迁移至开源和闭源模型,适合安全评测与防御研究者。

安全评估对判断对齐后的大型语言模型是否抵御越狱攻击至关重要。现有自动化测试方法主要依赖响应级反馈:每个候选提示需生成目标模型响应以评估攻击效果,成本高且对高度对齐的模型提供稀疏指导,因多数提示均以相同失败结果被拒绝。本文提出 NeuronFuzz,一种白盒模糊测试框架,利用内部安全神经元作为连续执行反馈进行大模型安全评估。SafetyOracle 将安全神经元激活转化为连续安全报警分数,可在预填充阶段获取,无需生成响应。为构建 SafetyOracle,NeuronFuzz 使用模板不变的有害与良性输入及稳定性感知选择,识别出一组紧凑的安全神经元,其激活能捕捉有害意图识别。此外,由于安全报警分数可微分,NeuronFuzz 利用其梯度定位敏感模板位置,并使用掩码语言模型生成流畅、上下文兼容的变异,保留原始有害内容并避免额外优化变量。我们在21个文本与多模态模型上评估 NeuronFuzz,覆盖五个白盒源模型,越狱发现率达76%-100%,最高超越基线48个百分点。其优化模板进一步实现零样本迁移至开放权重与六种专有目标模型,平均攻击成功率(ASR)与前五名集成攻击成功率(EASR)分别为69.6%/92.6%与44.1%/60.0%。

原文摘要 · Abstract (English)

Safety evaluation is critical for assessing whether aligned Large Language Models (LLMs) remain robust against jailbreak attacks. Existing automated testing methods, however, largely rely on response-level feedback: each candidate prompt typically requires generating a target-model response to evaluate its attack effectiveness. This process is expensive and, more importantly, provides only sparse guidance on strongly aligned models, where most candidates are rejected with the same failure outcome. This paper presents NeuronFuzz, a white-box fuzzing framework that exploits internal safety neurons as continuous execution feedback for LLM safety evaluation. A SafetyOracle converts safety-neuron activations into a continuous safety alarm score that serves as feedback for fuzzing and can be obtained during prefill, eliminating response generation from the fuzzing loop. To construct the SafetyOracle, NeuronFuzz uses template-invariant harmful and benign inputs and stability-aware selection to identify a compact set of safety neurons whose activations capture harmful-intent recognition. Moreover, since the safety alarm score is differentiable, NeuronFuzz uses its gradients to identify safety-sensitive template positions and a masked language model to generate fluent, context-compatible mutations while preserving original harmful payload and avoiding additional optimization variables. We evaluate NeuronFuzz across 21 text and multimodal models. Across five white-box source models, it achieves a 76-100% jailbreak discovery rate, outperforming baselines by up to 48 percentage points. Its optimized templates further transfer zero-shot to open-weight and six proprietary target models, achieving average ASR and top-5 ensemble ASR (EASR) of 69.6%/92.6% and 44.1%/60.0%, respectively.

大模型安全模糊测试越狱检测神经元分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。