arXiv:2509.26277cs.CV2025-09

通过分簇仿射变换,显著提升低比特量化模型的精度。

Cat: Post-Training Quantization Error Reduction via Cluster-based Affine Transformation

  • 用分簇仿射参数替代统一参数,更精准对齐量化与全精度输出。
  • 在W2A2 ResNet-18上实现53.18%的Top-1准确率,超越现有方法。
  • 无需微调模型或重新量化,可作为插件直接提升现有方案。

后训练量化(PTQ)通过将全精度(FP)数值转换为量化压缩数据类型,降低深度神经网络的内存占用和计算开销。尽管PTQ比量化感知训练(QAT)更高效,但在低比特量化(如2比特)下极易出现精度下降。仿射变换虽能缩小量化模型与全精度模型之间的信息差异,但传统全局统一参数的仿射变换在低比特场景下反而恶化性能。为此,本文提出分簇仿射变换(CAT),采用针对不同输出簇的专用参数,使低比特输出更贴近全精度结果。CAT仅引入极少额外参数,无需模型微调或量化参数重设。进一步构建的全新PTQ框架集成CAT,在ImageNet-1K上对多种架构和低比特设置均表现优异,最高达53.18% Top-1准确率。此外,作为插件使用时,可使现有PTQ基线提升超过3%。代码将在论文发表后开源。

原文摘要 · Abstract (English)

Post-Training Quantization (PTQ) reduces the memory footprint and computational overhead of deep neural networks by converting full-precision (FP) values into quantized and compressed data types. While PTQ is more cost-efficient than Quantization-Aware Training (QAT), it is highly susceptible to accuracy degradation under a low-bit quantization (LQ) regime (e.g., 2-bit). Affine transformation is a classical technique used to reduce the discrepancy between the information processed by a quantized model and that processed by its full-precision counterpart; however, we find that using plain affine transformation, which applies a uniform affine parameter set for all outputs, worsens the results in low-bit PTQ. To address this, we propose Cluster-based Affine Transformation (CAT), an error-reduction framework that employs cluster-specific parameters to align LQ outputs with FP counterparts. CAT refines LQ outputs with only a negligible number of additional parameters, without requiring fine-tuning of the model or quantization parameters. We further introduce a novel PTQ framework integrated with CAT. Experiments on ImageNet-1K show that this framework consistently outperforms prior PTQ methods across diverse architectures and LQ settings, achieving up to 53.18% Top-1 accuracy on W2A2 ResNet-18. Moreover, CAT enhances existing PTQ baselines by more than 3% when used as a plug-in. We plan to release our implementation alongside the publication of this paper.

量化后训练仿射变换低比特

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。