arXiv:2608.21952cs.AI2026-08中稿 · ICLR

针对状态空间双模架构提出首个8比特量化方案,兼顾精度与效率。

SSDi8: Accurate and Efficient 8-bit Quantization for State Space Duality

论文配图:SSDi8: Accurate and Efficient 8-bit Quantization for State Space Duality
图 1 · 摘自论文原文
  • 分离元素乘法与矩阵乘法,复用量化激活提升计算效率
  • 自适应量化通道变化激活,降低延迟;在W4A8/W8A8下提速1.4倍
  • 利用架构特性优化误差分布,适合边缘设备部署

序列建模最新进展突显Mamba作为状态空间架构的潜力,能高效建模长程依赖,是Transformer的可行替代。在此基础上,Mamba-2引入结构化状态空间双模(SSD),融合循环与注意力模式以实现高效可扩展。然而该架构扩展显著增加内存与延迟开销,亟需适配的压缩策略。本文提出首个专为SSD设计的后训练8比特量化框架SSDi8,维持持久的INT8路径。SSDi8通过重构将逐元素乘法与矩阵乘法解耦,实现量化激活跨模块复用;同时在成本效益点自适应量化随通道变化的激活,进一步降低延迟。精度方面,SSDi8显式利用SSD的内在维度分解特性,挖掘各轴差异化的异常值分布,并基于每通道误差统计引入误差校正项。大量实验表明,SSDi8在保持接近FP16精度的同时,在W4A8和W8A8设置下实现最高1.4倍加速。我们在Orin NX设备上验证了其在资源受限环境中的鲁棒性。

原文摘要 · Abstract (English)

Recent advances in sequence modeling have highlighted Mamba as a state space architecture offering efficient long-range dependency modeling and providing a viable alternative to Transformers. Building upon this, Mamba-2 introduces the Structured State Space Duality (SSD), which integrates recurrent and attention modes to achieve efficiency and scalability. However, this architectural expansion substantially increases memory and latency overhead, underscoring the need for efficient compression strategies tailored to SSD. In this work, we present SSDi8, the first post-training quantization framework specifically designed for SSD to maintain a persistent INT8 path. SSDi8 introduces a reformulation that decouples element-wise multiplications from matrix multiplications, enabling reuse of quantized activations across modules. Moreover, SSDi8 adaptively quantizes channel-varying activations at cost-effective points, further reducing latency. On the accuracy side, SSDi8 explicitly leverages the intrinsic dimensional decomposition of SSD, exploiting distinct outlier distributions across axes, and incorporates an error correction term based on per-channel error statistics. Comprehensive experiments demonstrate that SSDi8 achieves accuracy comparable to FP16 while delivering up to 1.4x speedup in W4A8 and W8A8 settings. We further validate its robustness in resource-constrained environments by deploying it on the Orin NX device.

量化状态空间Mamba边缘部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。