arXiv:2605.24817cs.CRcs.AR2026-05被引 1

通过GPU执行信号检测MoE模型中的有害提示,不碰用户数据也能审计安全。

RouteScan: A Non-Intrusive Approach to Auditing MoE LLMs Safety via Expert Routing Telemetry

论文配图:RouteScan: A Non-Intrusive Approach to Auditing MoE LLMs Safety via Expert Routing Telemetry
图 1 · 摘自论文原文
  • 利用预填充阶段专家模块的活跃线程数作为安全指纹。
  • 在四个MoE模型上实现AUROC超0.91的跨域检测效果。
  • 无需访问原始输入,适合注重隐私的安全审计场景。

随着混合专家(MoE)架构被广泛用于扩展大语言模型(LLMs),安全审计变得至关重要,以验证模型在运行中是否产生或助长有害行为。然而,现有基于内容的审计方法通常需要访问用户提示、模型内部或输出,可能泄露敏感用户信息,造成模型安全与用户隐私之间的矛盾。我们观察到,在MoE模型中,不同输入会引发不同的稀疏专家路由模式,这些模式在低层级GPU执行遥测中留下可测量痕迹。我们将由专家路由决策引发的硬件可观测信号称为专家路由遥测,其来源于GPU执行而非路由器逻辑值或词元级路由分配。受此启发,我们提出RouteScan,一种通过此类路由诱导的GPU遥测来检测有害行为的非侵入式审计框架。具体而言,RouteScan利用预填充阶段分配给专家模块的活跃GPU线程数作为区分性微架构指纹,并构建轻量级检测流水线,以隔离跨领域不变的风险指标,精准识别恶意提示。在四种具有不同路由设计的开源MoE LLM上的综合评估表明,RouteScan具备强大泛化能力,对未见有害领域达到超过0.91的AUROC。此外,隐私压力测试显示,尽管聚合执行遥测保留了输入相关属性信息,但在所评估攻击下,完整提示和精确敏感字段无法可靠恢复。

原文摘要 · Abstract (English)

As Mixture-of-Experts (MoE) architectures are increasingly adopted for scaling Large Language Models (LLMs), safety auditing becomes necessary to verify whether these models produce or facilitate harmful behaviors during operation. However, existing content-based auditing methods typically require access to user prompts, model internals, or outputs, potentially exposing sensitive user information and creating a tension between LLM safety and user privacy. On the other hand, we observe that, in MoE models, different inputs induce different sparse expert-routing patterns, which produce measurable footprints in low-level GPU execution telemetry. We refer to these hardware-observable signals induced by expert-routing decisions as expert routing telemetry; they are derived from GPU execution rather than from router logits or token-level routing assignments. Inspired by this observation, we propose RouteScan, a non-intrusive auditing framework for detecting harmful behaviors through such routing-induced GPU telemetry. Specifically, RouteScan utilizes the number of active GPU threads allocated to expert modules during the prefilling phase as a discriminative micro-architectural fingerprint, and builds a lightweight detection pipeline that isolates cross-domain invariant risk indicators for the precise identification of malicious prompts. Comprehensive evaluations on four open-source MoE LLMs with distinct routing designs demonstrate that RouteScan achieves strong generalization, with an AUROC exceeding 0.91 on unseen harmful domains. Moreover, privacy stress tests show that, although aggregated execution telemetry retains input-related attribute information, full prompts and exact sensitive fields cannot be reliably recovered under the evaluated attacks.

MoE模型安全审计隐私保护硬件遥测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。