arXiv:2606.26861cs.CL2026-06

提出分阶段多粒度剪枝框架,实现工业物联网设备上大模型高效压缩推理。

Cascaded Multi-Granularity Pruning for On-Device LLM Inference in Industrial IoT

  • 分层逐级剪枝,每阶段后用低秩恢复重估重要性
  • 在MHA+GELU架构上实现13.8倍压缩,准确率提升3.7个百分点
  • 揭示不同架构剪枝可靠性差异,适合边缘部署的LLM优化

将大语言模型(LLMs)部署于工业物联网(IIoT)边缘设备需极端压缩,但现有结构化剪枝方法在高压缩比下因一次性重要性评估失效且跨架构表现不可预测而失败。本文提出一种级联多粒度剪枝框架,按粗到细顺序剪除层、注意力头与前馈通道,并在各阶段间使用轻量低秩恢复重新估计组件重要性。信息论分析支持该剪枝顺序,同时形式化提出结构独立性假设(SIA),作为判断组件剪枝准则可靠性的可验证条件:多头注意力(MHA)+GELU架构满足SIA,而分组查询注意力(GQA)+SwiGLU架构违反该假设。在涵盖8800万至62.5亿参数的轴承故障诊断任务中,该框架在MHA+GELU架构上将压缩比提升至13.8倍,准确率达83.82%(较最强基线提升3.70个百分点);而在违反SIA的GQA+SwiGLU架构上则出现约74个百分点的准确率崩溃。在配备NVIDIA DGX Spark的工业回转轴承故障诊断平台上部署,压缩模型将推理延迟降低最高达67.2%,峰值内存减少62.5%,验证了其在IIoT边缘推理中的可行性。

原文摘要 · Abstract (English)

Deploying large language models (LLMs) on Industrial Internet of Things (IIoT) edge devices demands extreme compression, yet existing structured pruning methods collapse at high compression ratios due to one-shot importance estimation, and their cross-architecture behavior remains unpredictable. This article presents a cascaded multi-granularity pruning framework that removes layers, attention heads, and feed-forward channels in coarse-to-fine order, with lightweight low-rank recovery between stages to re-estimate component importance. An information-theoretic analysis motivates this ordering, and the Structural Independence Assumption (SIA) is formalized as a checkable condition predicting whether per-component pruning criteria are reliable for a given architecture: Multi-Head Attention (MHA)+GELU designs satisfy the SIA, whereas Grouped Query Attention (GQA)+SwiGLU designs violate it. On bearing fault diagnosis spanning 88M to 6.25B-parameter models, the framework extends achievable compression to 13.8 times on MHA+GELU architectures with 83.82% accuracy (+3.70 percentage points (pp) over the strongest baseline), while exposing a ~74pp accuracy collapse on GQA+SwiGLU architectures that violate the SIA. Deployed on an industrial slewing bearing fault diagnosis platform with NVIDIA DGX Spark, compressed models reduce inference latency by up to 67.2% and peak memory by 62.5%, demonstrating viability for IIoT edge inference.

模型压缩边缘计算剪枝工业AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。