arXiv:2604.01604cs.AI2026-04被引 1

找出大模型拒绝有害请求的核心机制,提升安全分析能力

CRaFT: Circuit-Guided Refusal Feature Selection via Cross-Layer Transcoders

论文配图:CRaFT: Circuit-Guided Refusal Feature Selection via Cross-Layer Transcoders
图 1 · 摘自论文原文
  • 通过跨层转换器构建特征电路图,捕捉特征间影响关系
  • 在4个越狱攻击测试中平均成功率从6.7%提升至57.4%
  • 适合研究模型安全、对抗攻击与可解释性的研究人员

尽管现代大语言模型已对有害请求具备拒绝能力,但理解其背后的机制对模型安全分析至关重要。例如,基于引导的越狱攻击会利用稀疏的神经元级拒绝特征来绕过安全防护。现有特征选择方法主要依赖特征在有害提示下的激活强度,但该指标常反映的是表层线索(如主题或词汇),而非真正因果机制。因此,识别拒绝特征需考察特征间的相互关系,而非孤立看待每个特征的激活。基于此,我们提出CRaFT——一种电路引导的拒绝特征选择框架,通过跨层转换器将模型内部计算映射为稀疏特征电路图,其中边表示特征间的影响力及其对最终输出logits的贡献。通过聚合传递到拒绝路径上的影响,CRaFT能有效排序最具影响力的特征。在四个越狱基准上的评估表明,与当前SOTA方法相比,CRaFT将平均性能从6.7%显著提升至57.4%,并生成更具体的有害内容。

原文摘要 · Abstract (English)

While modern LLMs are aligned to refuse harmful requests, it is essential to understand the underlying mechanistic basis of this refusal behavior for model safety analysis. For example, steering-based jailbreak attacks exploit this by identifying and manipulating sparse, neuron-like refusal features to bypass safety guardrails. Current feature selection methods primarily rely on how strongly features activate on harmful prompts. However, activation strength alone often captures superficial heuristics such as topic or lexical cues, rather than the true causal mechanisms. Thus, selecting refusal features requires measuring inter-feature relationships, rather than treating each feature as an isolated activation signal. Based on this insight, we propose CRaFT, a circuit-guided framework for identifying critical refusal features that directly govern the refusal decision. CRaFT leverages cross-layer transcoders to map the model's internal computations into a sparse feature circuit graph, where edges quantify inter-feature influences and their contributions to the final output logits. By aggregating the effects propagating along the paths to refusal, CRaFT effectively ranks the most influential features. Extensive evaluations across four jailbreak benchmarks show that CRaFT significantly improves average performance from 6.7% to 57.4% and generates more specific harmful completions compared to current SOTA methods.

模型安全可解释性越狱攻击特征选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。