提出组件感知剪枝方法,让控制模型在压缩后仍保持稳定
COMponent-Aware Pruning for Accelerated Control Tasks in Latent Space Models
- 按组件分组剪枝,动态确定每组最优压缩程度
- 在TD-MPC上实现模型压缩,同时保证控制稳定性和性能
- 给出安全压缩比阈值,适合边缘设备部署的控制器设计
资源受限的移动平台(如移动机器人、可穿戴设备和物联网设备)的快速发展,对计算效率高的神经网络控制器(NNC)提出了迫切需求。尽管深度神经网络(DNN)在控制任务中表现优异,但其高计算复杂度和内存开销阻碍了在边缘设备上的实际部署。本文提出一种基于组件感知结构化剪枝的综合模型压缩方法,为每个剪枝组确定最优压缩幅度,在压缩与稳定性之间取得平衡。该方法在时序差分模型预测控制(TD-MPC)这一前沿模型驱动强化学习算法上进行了系统验证,并融合了数学稳定性保障机制,特别是李雅普诺夫判据。核心贡献在于构建了一个理论框架,用于确定模型压缩的理论极限,同时确保控制器稳定性。实验表明,该方法能有效降低模型复杂度,同时维持所需的控制性能与稳定性。此外,本方法建立了安全压缩比的量化边界,使从业者能够系统判断在不破坏关键稳定性特性前提下的最大允许模型缩减量,从而促进压缩后NNC在资源受限环境中的可靠部署。
原文摘要 · Abstract (English)
The rapid growth of resource-constrained mobile platforms, including mobile robots, wearable systems, and Internet-of-Things devices, has increased the demand for computationally efficient neural network controllers (NNCs) that can operate within strict hardware limitations. While deep neural networks (DNNs) demonstrate superior performance in control applications, their substantial computational complexity and memory requirements present significant barriers to practical deployment on edge devices. This paper introduces a comprehensive model compression methodology that leverages component-aware structured pruning to determine the optimal pruning magnitude for each pruning group, ensuring a balance between compression and stability for NNC deployment. Our approach is rigorously evaluated on Temporal Difference Model Predictive Control (TD-MPC), a state-of-the-art model-based reinforcement learning algorithm, with a systematic integration of mathematical stability guarantee properties, specifically Lyapunov criteria. The key contribution of this work lies in providing a principled framework for determining the theoretical limits of model compression while preserving controller stability. Experimental validation demonstrates that our methodology successfully reduces model complexity while maintaining requisite control performance and stability characteristics. Furthermore, our approach establishes a quantitative boundary for safe compression ratios, enabling practitioners to systematically determine the maximum permissible model reduction before violating critical stability properties, thereby facilitating the confident deployment of compressed NNCs in resource-limited environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。