用分层强化学习同时实现模型剪枝与量化,自动压缩模型体积。
Hierarchical Reinforcement Learning for Neural Network Compression (HiReLC): Pruning and Quantization

- 分两层控制:底层每块独立选压缩参数,顶层统筹全局资源分配。
- 压缩5.99到6.72倍,多数情况准确率损失低于5.62%。
- 无需改结构,适配各类网络,尤其适合部署优化场景。
我们提出HiReLC,一种用于深度神经网络联合量化与结构化剪枝的分层集成强化学习框架。该框架在两个抽象层级上分解压缩搜索:低层智能体(LLAs)独立操作于每个模块,从包含比特数、保留率、量化类型和粒度的多离散动作空间中选择每核配置;高层智能体(HLAs)通过基于费舍尔信息的敏感性估计进行集成投票,协调全局预算分配。为降低策略评估开销,引入迭代主动学习循环,结合代理引导的强化学习优化与压缩后微调,使用轻量MLP代理来分摊昂贵评估成本,并在冷启动阶段采用对数几率-MSE代理。代理仅用于奖励塑造,不替代最终压缩评估。控制器设计为架构无关,通过模块化层抽象将强化学习环境与底层网络拓扑解耦。在视觉变换器与CNN基准上的实验表明,该方法实现了5.99至6.72倍的参数-存储压缩比,在某一设置下提升3.83%,其他场景准确率下降0.55%至5.62%,验证了分层策略分解与敏感性感知指导作为联合压缩实用设计的有效性。
原文摘要 · Abstract (English)
We present HiReLC, a hierarchical ensemble-reinforcement learning framework for automated joint quantization and structured pruning of deep neural networks. The framework decomposes the compression search across two levels of abstraction: low-level agents (LLAs) operate independently per block, selecting per-kernel configurations over a multi-discrete action space spanning bitwidth, pruning keep-ratio, quantization type, and granularity, while high-level agents (HLAs) coordinate global budget allocation via ensemble voting guided by Fisher Information-based sensitivity estimates. To mitigate the computational cost of policy evaluation, an iterative active learning loop interleaves surrogate-guided RL optimization with post-compression fine-tuning, using a lightweight MLP surrogate to amortize expensive evaluations and a logit-MSE proxy during cold-start. The surrogate is used for reward shaping rather than as a replacement for final post-compression evaluation. The controller is architecture-agnostic by design, with a modular layer abstraction decoupling the RL environment from the underlying network topology. Experiments across Vision Transformer and CNN benchmarks demonstrate effective parameter-storage compression ratios of 5.99 - 6.72$\times$ with a 3.83 % gain in one setting and 0.55 - 5.62 % accuracy drops elsewhere, supporting hierarchical policy decomposition and sensitivity-aware guidance as practical design choices for joint neural network compression.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。