arXiv:2605.02946cs.LGcs.AI2026-05被引 7

通过操控专家路由,让大模型说出违规内容,成功率超69%。

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs

论文配图:RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
图 1 · 摘自论文原文
  • 针对稀疏专家架构设计新攻击,利用输入优化影响路由决策。
  • 在7个MoE模型上平均成功率69.3%,比前人高3.2倍。
  • 零样本迁移能力强,适合研究模型安全与防御的团队参考。

安全对齐对大型语言模型的负责任部署至关重要。随着混合专家(MoE)架构被广泛采用以扩展模型容量,理解其安全性鲁棒性变得尤为关键。现有对抗攻击存在明显局限:基于提示的越狱依赖启发式搜索且泛化能力差,模型干预方法需访问内部表示,而基于优化的输入攻击因路由机制不可微,本质上受限于输出层面。本文提出RouteHijack,一种面向MoE LLMs的路由感知越狱攻击。核心洞察是安全行为集中于少数专家,可通过输入优化影响路由来引导模型行为。首先通过响应驱动的专家定位识别安全与有害专家;随后构建具有路由感知目标的对抗后缀,抑制安全专家、促进有害专家,并防止生成早期拒绝。推理时仅需附加至恶意提示,无需内部访问。在7个MoE LLM上,平均攻击成功率(ASR)达69.3%,较先前优化型攻击提升3.2倍。该方法还实现零样本跨5个同类模型迁移,平均ASR从27.7%提升至61.2%,并在3个基于MoE的视觉语言模型上将平均ASR从2.47%提高至38.7%。这些发现揭示了稀疏专家架构的根本漏洞,强调需超越输出级对齐的安全防御。

原文摘要 · Abstract (English)

Safety alignment is critical for the responsible deployment of large language models (LLMs). As Mixture-of-Experts (MoE) architectures are increasingly adopted to scale model capacity, understanding their safety robustness becomes essential. Existing adversarial attacks, however, have notable limitations. Prompt-based jailbreaks rely on heuristic search and transfer poorly, model intervention methods require privileged access to internal representations, and optimization-based input attacks remain output-centric and are fundamentally limited to MoE models due to the non-differentiable routing mechanism. In this paper, we present RouteHijack, a routing-aware jailbreak for MoE LLMs. Our key insight is that safety behavior is concentrated in a small subset of experts, creating an opportunity to steer model behavior by influencing routing decisions through input optimization. Building on this observation, RouteHijack first performs response-driven expert localization to identify safety-critical and harmful experts by contrasting activations under safe refusals and harmful completions. It then constructs adversarial suffixes with a routing-aware objective that suppresses safety experts, promotes harmful experts, and prevents early-stage refusal during generation. At inference time, the optimized suffix is appended to a malicious prompt, requiring only input access. Across seven MoE LLMs, RouteHijack achieves a 69.3\% average attack success rate (ASR), outperforming prior optimization-based attack by $3.2\times$. RouteHijack also transfers zero-shot across five sibling MoE variants, raising average ASR from 27.7\% to 61.2\%, and further generalizes to three MoE-based VLMs, increasing average ASR from 2.47\% to 38.7\%. These findings expose a fundamental vulnerability in sparse expert architectures and highlight the need for defenses beyond output-level alignment.

模型安全MoE架构越狱攻击路由机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。