arXiv:2601.01972cs.CLcs.AI2026-01中稿 · Findings of the As…被引 3

攻击者用特定短语让Mamba模型遗忘关键信息,暴露其安全漏洞。

Hidden State Poisoning Attacks against Mamba-based Language Models

  • 通过输入特殊短语污染隐藏状态,导致模型无法恢复信息。
  • 52B混合模型Jamba-1.7-Mini在触发攻击后完全失效,纯Transformer不受影响。
  • 研究揭示了攻击机制,可为防御系统提供设计依据。

状态空间模型(SSMs)如Mamba提供了与Transformer相比具有线性时间复杂度的高效替代方案,但其对抗鲁棒性尚未被充分研究。本文揭示了一种现象:特定短输入会引发模型的局部失忆,通过不可逆地覆盖隐藏状态中的信息,称为隐藏状态投毒攻击(HiSPA)。我们构建了基准测试RoBench-25,用于评估模型在遭遇HiSPA时的信息检索能力,结果确认了SSMs对此类攻击的高度脆弱性。即使最新的520亿参数混合模型Jamba-1.7-Mini在某些触发词下也完全崩溃,而纯Transformer模型则未受影响。此外,这些攻击显著削弱了Jamba模型在主流Open-Prompt-Injections基准上的表现,而纯Transformer模型无此问题。我们的理论和实证发现同样适用于Mamba-2,并分析了基于Mamba-2的混合模型Nemotron-3-Nano。最后,可解释性分析揭示了Mamba隐藏层在攻击过程中的模式,可用于构建防御系统。完整代码与数据见https://github.com/TortueSagace/hispa。

原文摘要 · Abstract (English)

State space models (SSMs) like Mamba offer efficient alternatives to Transformer-based language models, with linear time complexity. Yet, their adversarial robustness remains critically unexplored. This paper studies the phenomenon whereby specific short input phrases induce a partial amnesia effect in such models, by irreversibly overwriting information in their hidden states, referred to as a Hidden State Poisoning Attack (HiSPA). Our benchmark RoBench-25 allows evaluating a model's information retrieval capabilities when subject to HiSPAs, and confirms the vulnerability of SSMs against such attacks. Even the recent Jamba-1.7-Mini SSM--Transformer (a 52B hybrid model) collapses on RoBench-25 under some HiSPA triggers, whereas pure Transformers do not. We also observe that HiSPA triggers significantly weaken the Jamba model on the popular Open-Prompt-Injections benchmark, unlike pure Transformers. We further show that the theoretical and empirical findings extend to Mamba-2, and also analyse a Mamba-2-based hybrid (Nemotron-3-Nano). Finally, our interpretability study reveals patterns in Mamba's hidden layers during HiSPAs that could be used to build a HiSPA mitigation system. The full code and data to reproduce the experiments can be found at https://github.com/TortueSagace/hispa.

模型安全Mamba对抗攻击隐状态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。