发现Mamba模型仅1个比特翻转就导致性能崩溃,揭示状态空间模型的严重硬件脆弱性。
COBRA: Catastrophic Bit-flip Reliability Analysis of State-Space Models
- 设计专用攻击框架RAMBO,针对Mamba架构实施比特翻转攻击
- 单比特翻转使准确率从74.64%降至0%,困惑度飙升至375万
- 揭示状态空间模型在硬件故障下的极端不鲁棒性,适合安全与可靠性研究者
状态空间模型(SSMs),以Mamba架构为代表,近期成为先进的序列建模框架,具备线性时间扩展性及长上下文场景中的优异表现。由于其高效、可扩展且表达能力强,已成为克服注意力机制二次计算与内存开销的Transformer模型的有力替代方案。随着SSMs在实际应用中日益普及,评估其对软硬件威胁的脆弱性至关重要。其中,由硬件故障引发的比特翻转攻击(BFAs)通过篡改模型参数,严重破坏模型准确性与完整性。为此,我们提出RAMBO——首个专为Mamba架构设计的比特翻转攻击框架。在基于LAMBADA基准的闭合式词预测任务上,对Mamba-1.4b模型的实验表明,仅翻转一个关键比特即可使准确率从74.64%骤降至0%,困惑度从18.94升至3.75×10⁶。结果凸显了SSMs对对抗性扰动的高度脆弱性。
原文摘要 · Abstract (English)
State-space models (SSMs), exemplified by the Mamba architecture, have recently emerged as state-of-the-art sequence-modeling frameworks, offering linear-time scalability together with strong performance in long-context settings. Owing to their unique combination of efficiency, scalability, and expressive capacity, SSMs have become compelling alternatives to transformer-based models, which suffer from the quadratic computational and memory costs of attention mechanisms. As SSMs are increasingly deployed in real-world applications, it is critical to assess their susceptibility to both software- and hardware-level threats to ensure secure and reliable operation. Among such threats, hardware-induced bit-flip attacks (BFAs) pose a particularly severe risk by corrupting model parameters through memory faults, thereby undermining model accuracy and functional integrity. To investigate this vulnerability, we introduce RAMBO, the first BFA framework specifically designed to target Mamba-based architectures. Through experiments on the Mamba-1.4b model with LAMBADA benchmark, a cloze-style word-prediction task, we demonstrate that flipping merely a single critical bit can catastrophically reduce accuracy from 74.64% to 0% and increase perplexity from 18.94 to 3.75 x 10^6. These results demonstrate the pronounced fragility of SSMs to adversarial perturbations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。