arXiv:2608.25371cs.CVcs.CR2026-08

发现视觉MoE模型批处理依赖漏洞,提出隐蔽供应链后门攻击

Capacity Overflow: A Blind Spot for Backdoor Attacks in Vision MoE

论文配图:Capacity Overflow: A Blind Spot for Backdoor Attacks in Vision MoE
图 1 · 摘自论文原文
  • 利用批大小自适应容量机制,分三阶段植入隐蔽后门
  • 小批量时攻击成功率低于9%,大批量时达76%-87%
  • 可绕过多种检测方法,适合研究模型安全的学者

混合专家(MoE)已成为高效扩展视觉Transformer的主流架构。为保证计算可扩展性并防止专家过载,视觉MoE采用容量受限的令牌调度机制,其中每个专家的处理预算取决于推理批次大小。本文识别出这种批大小依赖行为是一个被忽视的攻击面,并提出一种隐蔽的供应链后门攻击,通过三阶段框架实现:首先在早期MoE层注入后门;其次在深层MoE层训练一个中和器,在正常容量下抑制后门;最后配置批自适应容量因子,对小批次保持高容量,而对大批次降低容量,从而在部署规模批次下通过令牌溢出自然禁用中和器。攻击在小批量安全审计时处于休眠状态,大规模部署时进入激活状态。在V-MoE与Swin-MoE上,基于ImageNet-100与GTSRB的实验表明,激活模式攻击成功率达76%-87%,休眠模式攻击成功率低于9%,且可规避Neural Cleanse、STRIP、Fine-Pruning和激活聚类等检测方法。研究揭示了可扩展视觉MoE架构中批大小依赖执行带来的根本性安全风险。

原文摘要 · Abstract (English)

Mixture-of-Experts (MoE) has become a prevalent paradigm for scaling Vision Transformers efficiently. To ensure computational scalability and prevent expert overload, Vision MoE architectures employ a capacity-bounded token dispatch mechanism, where each expert's processing budget depends on the inference batch size. This work identifies this batch-dependent behavior as an overlooked attack surface, and proposes a stealthy supply-chain backdoor attack that exploits this property through a three-phase framework. First, we inject a backdoor into an early MoE layer. Second, we train a neutralizer in a deeper MoE layer that suppresses the backdoor under normal capacity. Third, we configure a batch-adaptive capacity factor that preserves high capacity for small batches while reducing it for large batches, naturally disabling the neutralizer via token overflow at deployment-scale batch sizes. The attack remains in dormant mode during small-batch security audits and enters activation mode during large-batch deployment. Experiments on V-MoE and Swin-MoE across ImageNet-100 and GTSRB demonstrate activation-mode attack success rates of 76-87% with dormant-mode ASR below 9%, while evading Neural Cleanse, STRIP, Fine-Pruning, and Activation Clustering. Our findings reveal a fundamental security risk arising from batch-dependent execution in scalable Vision MoE architectures.

后门攻击视觉MoE模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。