arXiv:2508.03002cs.LG2025-08IJCAI被引 2

用博弈论方法更准确地分配神经网络各层的量化位宽,提升模型压缩效果。

Where and How to Enhance: Discovering Bit-Width Contribution for Mixed Precision Quantization

  • 基于谢尔比(Shapley)值衡量每层位宽对精度的真实贡献
  • 在多个主流数据集上优于传统梯度优化方法,精度损失更小
  • 适合需要高精度压缩的部署场景,如移动端模型优化

混合精度量化(MPQ)通过为网络各层的激活和权重分配不同位宽,实现精度与复杂度的平衡。现有方法通常采用可微分方式(DMPQ)优化量化策略,即根据量化参数的大小选择最高贡献位宽。然而,我们发现量化参数的数值大小并不一定反映其对任务性能的实际贡献。为此,提出基于谢尔比值的混合精度量化方法(SMPQ),精准测量各层位宽对任务性能的直接贡献。为降低计算开销,引入蒙特卡洛采样近似策略加速谢尔比值计算。在多个主流基准测试上,SMPQ持续优于基于梯度的方法,达到当前最优性能。

原文摘要 · Abstract (English)

Mixed precision quantization (MPQ) is an effective quantization approach to achieve accuracy-complexity trade-off of neural network, through assigning different bit-widths to network activations and weights in each layer. The typical way of existing MPQ methods is to optimize quantization policies (i.e., bit-width allocation) in a gradient descent manner, termed as Differentiable (DMPQ). At the end of the search, the bit-width associated to the quantization parameters which has the largest value will be selected to form the final mixed precision quantization policy, with the implicit assumption that the values of quantization parameters reflect the operation contribution to the accuracy improvement. While much has been discussed about the MPQ improvement, the bit-width selection process has received little attention. We study this problem and argue that the magnitude of quantization parameters does not necessarily reflect the actual contribution of the bit-width to the task performance. Then, we propose a Shapley-based MPQ (SMPQ) method, which measures the bit-width operation direct contribution on the MPQ task. To reduce computation cost, a Monte Carlo sampling-based approximation strategy is proposed for Shapley computation. Extensive experiments on mainstream benchmarks demonstrate that our SMPQ consistently achieves state-of-the-art performance than gradient-based competitors.

量化混合精度模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。