arXiv:2605.24270cs.AIcs.CR2026-05

分析Mixtral模型在安全提示下的路由行为,发现其决策分布于多层专家,非单一专家主导。

Safety-Oriented Routing Analysis of Mixtral MoE Under Benign and Harmful Prompts

论文配图:Safety-Oriented Routing Analysis of Mixtral MoE Under Benign and Harmful Prompts
图 1 · 摘自论文原文
  • 结合激活频率与梯度敏感度,双重分析专家路由机制
  • 安全相关路由集中于中后层,且多数专家跨提示类型共享
  • 干预实验表明抑制特定专家可减少不当响应,但影响有限

稀疏混合专家(MoE)语言模型仅对每个词元激活少量参数,路由行为成为计算核心。本文通过激活频率和梯度敏感度两种互补信号,研究Mixtral 8x7B-Instruct在良性与有害提示下的路由表现。结果表明:基于激活的专家使用呈广谱长尾分布,而基于梯度的重要性高度集中;在专家层面,良性与有害提示组别在两种信号下均保持接近,分离度较小;在层层面,激活路由在第8-15层最具有选择性,梯度重要性则集中在最后几层。专家分类显示多数专家在两类提示间共享,仅少数具明显偏好。排名靠前的专家集在梯度评分下表现出更强的良性与恶意重叠,暗示其集中于共同的后期专家集。干预实验中,抑制前五名以激活得分为主的良性主导专家,使100个提示中的受限响应从24次降至14次;抑制梯度衍生专家则从34次降至22次,且副作用更少。总体而言,安全相关的路由行为微妙、深度依赖、分布广泛,而非由固定专家集主导。

原文摘要 · Abstract (English)

Sparse mixture-of-experts (MoE) language models activate only a small subset of parameters for each token, making router behavior a central part of model computation. This paper studies routing behavior of Mixtral 8x7B-Instruct under benign and harmful prompts using two complementary signals: activation-based routing scores derived from expert selection frequencies and gradient-based scores derived from router-gate sensitivities. We analyze expert- and layer-level routing behavior and conduct expert-suppression interventions. The results show that activation-based expert usage is broad and long-tailed, whereas gradient-based importance is concentrated. At expert level, benign and harmful prompt groups remain close under both signals with modest separation. At layer level, activation-based routing is most selective around layers 8-15, while gradient-based importance is concentrated in final layers. Expert classification shows most experts are shared across benign and harmful prompts, though a limited subset shows clear group preference. Top-ranked expert sets show stronger benign-malicious overlap under gradient scores than activation scores, suggesting concentration on a common late-layer expert set. In intervention experiments, suppressing top five benign-dominant experts from activation scores reduces restricted responses from 24 to 14 over 100 prompts, while suppressing gradient-derived experts reduces them from 34 to 22 with fewer unintended reversals. Overall, safety-relevant routing in Mixtral is subtle, depth-dependent, and distributed rather than dominated by a fixed set of experts.

MoE路由分析安全大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。