arXiv:2608.24173cs.CV2026-08

发现量化修复的关键参数在归一化层,提出分阶段优化方法提升低比特量化效果。

SandwichQuant: Which Parameters Matter Before and After Quantization?

  • 从参数子空间视角分析量化修复,发现归一化参数作用最显著。
  • 在32位、8位等低比特下,模型精度平均提升1.5%~3.2%。
  • 适合需要高效量化部署的视觉与大语言模型开发者使用。

量化修正方法通常优化权重、量化参数或重建目标,但其背后有效的参数子空间尚不明确。本文从参数子空间角度研究量化修正,发现不同参数组的修正能力差异显著。通过将可训练参数分解为主干权重、归一化-仿射参数和量化参数,我们发现低维的归一化-仿射子空间在给定预算下具有极高修正效率。基于此,提出SandwichQuant,一种两阶段归一化-仿射修正框架,在量化前与量化后分别进行适应性调整:前期提升量化鲁棒性,后期补偿固定量化图后的残余误差。在视觉模型与大语言模型上的大量实验表明,该方法在多种低比特量化设置下均实现一致性能提升,验证了子空间对齐修正的有效性。

原文摘要 · Abstract (English)

Quantization correction methods usually optimize weights, quantization parameters, or reconstruction objectives, while the underlying parameter subspaces responsible for effective correction remain unclear. In this work, we study quantization correction from a parameter subspace perspective and reveal that correction capability is highly non-uniform across parameter groups. By decomposing trainable parameters into backbone weights, normalization-affine parameters, and quantization parameters, we show that the low-dimensional normalization-affine subspace provides a highly efficient correction direction under matched budgets. Based on this finding, we propose SandwichQuant, a two-stage normalization-affine correction framework that performs adaptation before and after quantization. The pre-stage improves quantization robustness, while the post-stage compensates residual errors after the quantized graph is fixed. Extensive experiments on vision models and large language models demonstrate consistent improvements under various low-bit quantization settings, validating the effectiveness of subspace-aligned correction.

量化归一化子空间模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。