arXiv:2606.18096cs.LGcs.AI2026-06

通过逐层剪枝提升SSM模型效率,让低资源设备也能用。

S4oP: Operator-level Pruning of Structured State Space Models for Resource-Constrained Devices

论文配图:S4oP: Operator-level Pruning of Structured State Space Models for Resource-Constrained Devices
图 1 · 摘自论文原文
  • 按操作符层级逐步剪枝,边剪边微调保持性能。
  • 剪掉70%操作符后仍保持原模型准确率,延迟大幅下降。
  • 首次系统研究SSM的结构化剪枝,适合边缘部署场景。

结构化状态空间模型(SSMs),包括S4和S4D架构,近年来成为捕捉序列数据长程依赖的强大替代方案。尽管其表现优异,但在时间与资源受限场景中部署仍面临计算和内存压力。本文提出一种新型增量式、操作符级剪枝方法,针对基于S4和S4D的模型,在显著降低推理成本的同时保持预测性能。据我们所知,这是首个系统研究SSM结构化操作符剪枝的工作。该方法通过交替使用结构化掩码与微调,逐步剪除模型操作符,并联合监控准确率与推理延迟。我们在统一训练与评估框架下实现该方法,可系统探索效率与精度之间的权衡。在多个基准数据集上的实验表明,剪除高达70%的操作符后,多数情况下仍能保持原始模型性能,同时大幅降低推理延迟。结果证明,结构化操作符剪枝是提升SSM效率的有效且此前未被探索的策略,有助于其实用化部署于资源受限场景。

原文摘要 · Abstract (English)

Structured State Space Models (SSMs), including the S4 and S4D architectures, have recently emerged as powerful alternatives to attention-based models for capturing long-range dependencies in sequential data. Despite their strong empirical performance, deploying these models in time- and resource-constrained settings remains challenging due to their computational and memory demands. In this paper, we propose a novel incremental, operator-level pruning approach for S4- and S4D-based models that significantly reduces inference cost while preserving predictive performance. To the best of our knowledge, this is the first work to systematically investigate structured operator pruning for SSMs. Our method progressively prunes model operators by interleaving structured masking with fine-tuning, while jointly monitoring accuracy and inference latency. We implement this approach within a unified training and evaluation framework that enables systematic exploration of efficiency-accuracy trade-offs. Experiments across multiple benchmark datasets show that pruning up to 70% of the model operators preserves the performance of the original models in most cases, while substantially reducing inference latency. These results demonstrate that structured operator pruning is an effective and previously unexplored strategy for improving the efficiency of SSMs and facilitate their deployment in practical, resource-constrained scenarios.

模型剪枝状态空间边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。